v3.240716.patch1

Cherry pick #8581 to the v3.240716 to bump WMCore version to 2.3.3. Fixing "Unsupported architecture el9" error.

v3.240731

This tag mainly brings in :

• a new task status, to differentiate between tasks submission failures that are caused by user problems and by CRAB system problems: Add submitrefused 7989 by @belforte in #8564
• a fix about monitoring in crabserver REST: Add monitoring script back to REST's PyPI image by @novicecpp in #8569

What's Changed

Moreover, this tag brings in the new CRABUtils/TaskUtils.py module

• add CRABUtils/TaskUtils.py by @belforte in #8557
• use common functions from CRABUtils/TaskUtils fix #7671 by @belforte in #8570

an improvement of the resilience of FTS_Transfers to FTS errors

• put all calls to fts3.get_job_status in try/except Fix #8556 by @belforte in #8558

an improvement in Publisher pypi image:

• Fixing PB entrypoint by @novicecpp in #8562

and some other changes

• Small fixes for rucio publisher by @belforte in #8566
• Add vchakrav remote repository to addGH.sh by @aspiringmind-code in #8551
• More verbose for cicd/rucio/cleanup.py by @novicecpp in #8565
• Fix TW config section does not exist when hardcode some values in pdb mode by @novicecpp in #8552
• [CI] fix SUBMIT_STATUS_TRACKING by @novicecpp in #8553
• [CI] Support CRABClient GH by @novicecpp in #8554
• [CI] Add Vijay dev env by @novicecpp in #8555
• Update .gitignore by @novicecpp in #8560

Full Changelog: v3.240716...v3.240731

v3.240716

This tag brings in change to the tape recall policy, in particular, tape recall expire 4 days after recall is completed and there's a limit on how much every user can recall.

What's Changed

• Limiting Tape recall days to now+4 days by @aspiringmind-code in #8548
• add per-user tape recall policy. Fix #8354 by @belforte in #8544

Full Changelog: v3.240709...v3.240716

v3.240709

Regular update production image.
In addition, congratulations to our new colleague, Vijay Chakravarty @aspiringmind-code, for the first PR.

What's Changed

• print time zone in logs and when next test iteration will be by @belforte in #8534
• Add ChildWorker module by @novicecpp in #8527
• fix rucio.cfg . Fixes #8535 by @belforte in #8536
• Fix TRACE in script and reduce verbosity of updateDatafiles.sh by @novicecpp in #8538
• Remove HTCondorUtils.py #8339 by @aspiringmind-code in #8531
• bump HTC bindings to 23.9.0a3 by @belforte in #8547
• Use simple py script as the entrypoint of TW process by @novicecpp in #8541

New Contributors

• @aspiringmind-code made their first contribution in #8531

Full Changelog: v3.240627...v3.240709

v3.240627

this release brings

improvements to pipeline and fix to Publisher_rucio

What's Changed

• Fix various CIs by @novicecpp in #8514
• reduce to minimum taskworker dependencies. Fix #8518 by @belforte in #8520
• Remove htc from rest 8338 by @belforte in #8523
• Publisher rucio to check block completion 8491 by @belforte in #8526
• store also scope in tm_dbs_blockname. Quick fix for #8525 by @belforte in #8530
• Adatp Pub_rucio to scope:name in dbs_blockname by @belforte in #8533

Full Changelog: v3.240618...v3.240627

Validation: https://gitlab.cern.ch/crab3/CRABServer/-/pipelines/7650298

v3.240618

this is the first attempt at tagging Master branch after merging with Modernize_HTC
this TW worked in test2 using ./start.sh -g : #8513

What's Changed

• [PYPI] bump htcondor in pypi image to 23.0.12 by @novicecpp in #8492
• Merge modernize htc by @belforte in #8503
• Fix pre job by @belforte in #8507
• Fix #8509 by @belforte in #8511
• add /etc/condor/condor_config to TW Fix #8497 by @belforte in #8499
• second attempt to fix #8509 by @belforte in #8512
• monit - use taskworker pypi image as base docker image for monitoring scripts by @mapellidario in #8505

Full Changelog: v3.240607...v3.240618

Validation OK on cmsweb-testbed/crab-preprod-tw01
https://gitlab.cern.ch/crab3/CRABServer/-/jobs/40241858
#8515
#8516
#8517

modernize_HTC_0616

fixes a few issues found while testing

What's Changed

• Modernize htc by @belforte in #8493
• Modernize htc by @belforte in #8495

Full Changelog: modernize_HTC_0611...modernize_HTC_0616

Validation: #8501

All Jenkins OK

modernize_HTC_0611

fix all know problems so far.
Should work using JDL to submit Dagman.
Some use of deprecated HTC bindings sitll possible, to be "looked for".
More testing needed.
Should be a good base for testing htcondor2/classad2

validation: #8489

What's Changed

• first version which works using JDL to submit dag by @belforte in #8486
• use HTC bindings 23.9.0a2 by @belforte in #8487

Full Changelog: modernize_HTC_0604...modernize_HTC_0611

v3.240607.test1

Testing PR #8483

v3.240607

Cutting the release for #8482.

What's Changed

• Run test jobs on crab sched 903 by @belforte in #8472
• Revert "Run test jobs on crab sched 903 (#8472)" by @belforte in #8474
• do not indicate unused args in FTS calls. Fix #8460 by @belforte in #8475
• Revert to v3.240530 by @belforte in #8478
• do not rely in ServerTime. For #8480 by @belforte in #8481
• make compatible with FTS clients 3.13/14 fix #8460 by @belforte in #8482

Full Changelog: v3.240603...v3.240607