Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

automatic splitting does not work anymore #8464

Closed
belforte opened this issue Jun 3, 2024 · 3 comments
Closed

automatic splitting does not work anymore #8464

belforte opened this issue Jun 3, 2024 · 3 comments

Comments

@belforte
Copy link
Member

belforte commented Jun 3, 2024

after last changes for modern HTCondor the main dag in automatic splitting writes in
task_process/RestInfoForFileTransfers.json

{'host': 'cmsweb-testbed.cern.ch:8443', 'dbInstance': 'preprod', 'proxyfile': '/data/srv/glidecondor/condor_local/spool/5130/0/cluster9615130.proc0.subproc0/e080907cad69528d423bbe562e2f8f9873b2c933'}

i.e. the full path for the proxy file,
this conflicts with code in FTS_Transfers

proxy = os.getcwd() + "/" + str(restInfo['proxyfile']) # make sure no to unicode to FTS clients

and the directory path is added twice making FTS calls fail.

@belforte
Copy link
Member Author

belforte commented Jun 3, 2024

The effect of this is that ASO stays in "transferring" forever, which I did not notice initially sine ASO was stuck for everybody due to #8460

belforte added a commit to belforte/CRABServer that referenced this issue Jun 3, 2024
@belforte
Copy link
Member Author

belforte commented Jun 3, 2024

@belforte
Copy link
Member Author

belforte commented Jun 3, 2024

test worked.
Will merge and deploy to preprod for more validation

belforte added a commit to belforte/CRABServer that referenced this issue Jun 3, 2024
belforte added a commit to belforte/CRABServer that referenced this issue Jun 5, 2024
belforte added a commit that referenced this issue Jun 5, 2024
* Revert "Revert "Run test jobs on crab sched 903 (#8472)" (#8474)"

This reverts commit 0665454.

* Revert "Run test jobs on crab sched 903 (#8472)"

This reverts commit c5ec3ef.

* Revert "ensure proxyfile in RestInfoForFileTransfers.json is a filename w/o path. Fix #8464 (#8467)"

This reverts commit 9ced4fd.

* Revert "workaround for #8456 (#8466)"

This reverts commit 602f8d6.

* Revert "Update makeTests.py: collector param does not allow port #. Simply put FNAL first"

This reverts commit 7ac2b90.

* Revert "Update makeTests.py: add collector port for ITB"

This reverts commit f6c01eb.

* Revert "do not set RequestCpus in task submission JDL. Fix #8456 (#8457)"

This reverts commit 198e2d3.

* Revert "pass string, not bytes, to htcondor.param Fix #8450 (#8452)"

This reverts commit 856d1ef.

* Revert "schedd.xquery is deprecated. Use schedd.query. Fix #8447 (#8449)"

This reverts commit b129645.

* Revert "new format of schedd.submit)/spool() fix #8336 fix #8333 (#8448)"

This reverts commit 806226a.

* Revert "do not indicate unused args in FTS calls. Fix #8460 (#8475)"

This reverts commit 20d4f90.
belforte added a commit to belforte/CRABServer that referenced this issue Jun 28, 2024
belforte added a commit to belforte/CRABServer that referenced this issue Jun 28, 2024
* Revert "Revert "Run test jobs on crab sched 903 (dmwm#8472)" (dmwm#8474)"

This reverts commit 0665454.

* Revert "Run test jobs on crab sched 903 (dmwm#8472)"

This reverts commit c5ec3ef.

* Revert "ensure proxyfile in RestInfoForFileTransfers.json is a filename w/o path. Fix dmwm#8464 (dmwm#8467)"

This reverts commit 9ced4fd.

* Revert "workaround for dmwm#8456 (dmwm#8466)"

This reverts commit 602f8d6.

* Revert "Update makeTests.py: collector param does not allow port #. Simply put FNAL first"

This reverts commit 7ac2b90.

* Revert "Update makeTests.py: add collector port for ITB"

This reverts commit f6c01eb.

* Revert "do not set RequestCpus in task submission JDL. Fix dmwm#8456 (dmwm#8457)"

This reverts commit 198e2d3.

* Revert "pass string, not bytes, to htcondor.param Fix dmwm#8450 (dmwm#8452)"

This reverts commit 856d1ef.

* Revert "schedd.xquery is deprecated. Use schedd.query. Fix dmwm#8447 (dmwm#8449)"

This reverts commit b129645.

* Revert "new format of schedd.submit)/spool() fix dmwm#8336 fix dmwm#8333 (dmwm#8448)"

This reverts commit 806226a.

* Revert "do not indicate unused args in FTS calls. Fix dmwm#8460 (dmwm#8475)"

This reverts commit 20d4f90.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant