Run3-hcx170C Backport PRs #42463, #42496, #42549, #42550, #42557, #42578 to fix run3 scenario in CMSSW version 13_0_X due to issues in HCAL

[bsunanda]

PR description:

Backport PRs #42463, #42496, #42549, #42550, #42557, #42578 to fix run3 scenario in CMSSW version 13_0_X due to issues in HCAL

PR validation:

Use the runTheMatrix test workflows

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

Backport parts of PRs #42463, #42496, #42549, #42550, #42557, #42578

[cmsbuild]

A new Pull Request was created by @bsunanda (Sunanda Banerjee) for CMSSW_13_0_X.

It involves the following packages:

• Configuration/Geometry (geometry, upgrade)
• Geometry/CMSCommonData (geometry, upgrade)
• Geometry/HcalCommonData (geometry)
• Geometry/HcalSimData (geometry)

@civanch, @Dr15Jones, @bsunanda, @makortel, @mdhildreth, @cmsbuild, @AdrianoDee, @srimanob can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @missirol, @fabiocos, @slomeo, @vargasa this is something you requested to watch as well.
@perrotta, @dpiparo, @antoniovilela, @rappoccio you are the release manager for this.

cms-bot commands are listed here

[bsunanda]

@cmsbuild Please test

[cmsbuild]

-1

Failed Tests: RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-611aad/34392/summary.html
COMMIT: 9c7be4a
CMSSW: CMSSW_13_0_X_2023-08-21-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42621/34392/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

• 11634.911

----- Begin Fatal Exception 21-Aug-2023 19:34:04 CEST-----------------------
An exception of category 'StdException' occurred while
   [0] Processing global begin Run run: 1
   [1] Prefetching for module OscarMTProducer/'g4SimHits'
   [2] Prefetching for EventSetup module MuonOffsetESProducer/'muonOffsetESProducer'
   [3] Prefetching for EventSetup module DDCompactViewESProducer/''
   [4] Calling method for EventSetup module DDDetectorESProducer/''
Exception Message:
A std::exception was thrown.
An exception of category 'FileInPathError' occurred.
Exception Message:
edm::FileInPath unable to find file Geometry/HcalCommonData/data/hcalsens/2021/v2/hcalsenspmf.xml anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42621/34392/CMSSW_13_0_X_2023-08-21-1100/poison:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42621/34392/CMSSW_13_0_X_2023-08-21-1100/src:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42621/34392/CMSSW_13_0_X_2023-08-21-1100/external/el8_amd64_gcc11/data:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02799/el8_amd64_gcc11/cms/cmssw-patch/CMSSW_13_0_X_2023-08-21-1100/poison:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02799/el8_amd64_gcc11/cms/cmssw-patch/CMSSW_13_0_X_2023-08-21-1100/src:/cvmfs/cms-ib.cern.ch/sw/x86_64/nweek-02799/el8_amd64_gcc11/cms/cmssw-patch/CMSSW_13_0_X_2023-08-21-1100/external/el8_amd64_gcc11/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/11634.911_TTbar_14TeV+2021_DD4hep

dd4hep: Error interpreting XML nodes of type <Include/>
dd4hep: Error interpreting XML nodes of type <IncludeSection/>
dd4hep: while parsing /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42621/34392/CMSSW_13_0_X_2023-08-21-1100/src/Geometry/CMSCommonData/data/dd4hep/cmsExtendedGeometry2021.xml
dd4hep: with plugin:DD4hep_CompactLoader
----- End Fatal Exception -------------------------------------------------

[cmsbuild]

Pull request #42621 was updated. @civanch, @Dr15Jones, @bsunanda, @makortel, @mdhildreth, @cmsbuild, @AdrianoDee, @srimanob can you please check and sign again.

[bsunanda]

@cmsbuild Please test

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-611aad/34401/summary.html
COMMIT: 6709b27
CMSSW: CMSSW_13_0_X_2023-08-21-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42621/34401/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially removed 34 lines from the logs
• Reco comparison results: 2887 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3281270
• DQMHistoTests: Total failures: 5290
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3275958
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
• Checked 213 log files, 164 edm output root files, 49 DQM output files
• TriggerResults: found differences in 1 / 47 workflows

[bsunanda]

+geometry

[srimanob]

@cms-sw/orp-l2 @bsunanda
How about this PR? Do we still need it?

[civanch]

@bsunanda , likely this PR may be closed.

[antoniovilela]

@bsunanda , likely this PR may be closed.

Let's close.

[antoniovilela]

please close