Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SubProcess bug fix, updateLookup called too early #46871

Merged
merged 1 commit into from
Dec 10, 2024

Conversation

wddgit
Copy link
Contributor

@wddgit wddgit commented Dec 4, 2024

PR description:

This is a bug fix that should only affect jobs using SubProcess. For ESProducers, the updateLookup function was being called too early. For SubProcesses, there is a late step where sharing of ESProducers is checked and new ESProducers might be created at that point. We have been calling ESProducer::updateLookup just before that so ESProducers constructed at that late time would have missed the call to updateLookup.

This only affects jobs with SubProcess and none of the CMS production jobs use that feature. It is also somewhat of an unusual corner case even in a job with SubProcess. As far as I know, the Core unit tests are the only tests using SubProcess.

PR validation:

Existing unit tests pass.

I noticed this while developing a separate PR. I will submit the other PR in the near future and it contains code modifications that cause existing unit tests to fail because of this bug (that is how I noticed the bug in the first place, it has been lurking there for years).

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 4, 2024

cms-bot internal usage

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 4, 2024

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 4, 2024

A new Pull Request was created by @wddgit for master.

It involves the following packages:

  • FWCore/Framework (core)

@Dr15Jones, @cmsbuild, @makortel, @smuzaffar can you please review it and eventually sign? Thanks.
@makortel, @missirol this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@wddgit
Copy link
Contributor Author

wddgit commented Dec 4, 2024

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 5, 2024

-1

Failed Tests: RelVals RelVals-INPUT
Size: This PR adds an extra 44KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-94b65f/43260/summary.html
COMMIT: 0c1e0d5
CMSSW: CMSSW_15_0_X_2024-12-04-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/46871/43260/install.sh to create a dev area with all the needed externals and cmssw changes.

  • DAS Queries: The DAS query tests failed, see the summary page for details.

RelVals

  • 2024.303001DAS Error
  • 2022.002001DAS Error
  • 2024.000001DAS Error
Expand to see more relval errors ...
  • 2024.101001
  • 2022.000001
  • 2024.202001
  • 2023.002001

RelVals-INPUT

  • 2024.300001DAS Error
  • 2024.103001DAS Error
  • 2024.102001DAS Error
Expand to see more relval errors ...
  • 2024.200001
  • 2024.202001
  • 2024.303001
  • 2024.002001
  • 2024.000001
  • 2023.001001
  • 2024.302001
  • 2024.101001
  • 2022.000001
  • 2023.000001
  • 2022.001001
  • 2024.201001
  • 2024.100001
  • 2024.203001
  • 2024.003001
  • 2024.001001
  • 2023.002001
  • 2022.002001
  • 2024.301001

@wddgit
Copy link
Contributor Author

wddgit commented Dec 5, 2024

please test

Try again. Bunch of DAS Errors. I don't this could be related to the PR. I see them in one of the IBs also.

@makortel
Copy link
Contributor

makortel commented Dec 5, 2024

Looks good to me. @Dr15Jones could you also take a look?

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 5, 2024

+1

Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-94b65f/43279/summary.html
COMMIT: 0c1e0d5
CMSSW: CMSSW_15_0_X_2024-12-05-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/46871/43279/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 7 differences found in the comparisons
  • DQMHistoTests: Total files compared: 46
  • DQMHistoTests: Total histograms compared: 3494042
  • DQMHistoTests: Total failures: 467
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3493555
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 45 files compared)
  • Checked 202 log files, 172 edm output root files, 46 DQM output files
  • TriggerResults: found differences in 1 / 44 workflows

@wddgit
Copy link
Contributor Author

wddgit commented Dec 5, 2024

Comparison failures are very similar to those seen in the completely unrelated PR #46859 from about the same time period. So I don't think they are related to this PR.

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 9, 2024

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 9, 2024

Pull request #46871 was updated. @Dr15Jones, @cmsbuild, @makortel, @smuzaffar can you please check and sign again.

@wddgit
Copy link
Contributor Author

wddgit commented Dec 9, 2024

I added two comments to the code in EventSetupsController.cc as we discussed verbally earlier today. Let me know if there are any more review comments.

@wddgit
Copy link
Contributor Author

wddgit commented Dec 9, 2024

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 9, 2024

+1

Size: This PR adds an extra 24KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-94b65f/43341/summary.html
COMMIT: 126bf82
CMSSW: CMSSW_15_0_X_2024-12-09-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46871/43341/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

@makortel
Copy link
Contributor

makortel commented Dec 9, 2024

Comparison differences are related to #39803 and #46416

@makortel
Copy link
Contributor

makortel commented Dec 9, 2024

+core

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 9, 2024

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @mandrenguyen, @antoniovilela, @sextonkennedy, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

@mandrenguyen
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 87f3f24 into cms-sw:master Dec 10, 2024
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants