Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch to pfCandidates for b tagging for Puppi jets #22696

Merged
merged 1 commit into from Mar 26, 2018
Merged

Switch to pfCandidates for b tagging for Puppi jets #22696

merged 1 commit into from Mar 26, 2018

Conversation

ghost
Copy link

@ghost ghost commented Mar 21, 2018

Solution to the issue discussed here: #22608

Switch back to standard pfCandidates for b tagging also for Puppi jets, reverting the change introduced in: #18666

This change was introduced as it was giving some b tagging performance improvement for Phase2, which is not there anymore with the new Puppi cuts for Phase 2.

Going back to pfCandidates for b tagging recovers in a satisfactory way the performance as shown in the red curves below. It's also a safer choice as it does not expose b tagging to changes in the Puppi algorithm and its parameters.

image

image

The performance of the red curves (standard b tagging with pfCandidates and Phase 2 Puppi cuts) is close now to the black curves, using special custom Phase 2 cuts, which was essentially the attempted solution in #22608.

The PR can be backported to 93X and included in: #22554

@cmsbuild
Copy link
Contributor

The code-checks are being triggered in jenkins.

@ghost
Copy link
Author

ghost commented Mar 21, 2018

@kpedro88

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @imarches for master.

It involves the following packages:

PhysicsTools/PatAlgos

@perrotta, @monttj, @cmsbuild, @slava77, @gpetruc, @arizzi can you please review it and eventually sign? Thanks.
@TaiSakuma, @gouskos, @imarches, @ahinzmann, @acaudron, @mmarionncern, @rappoccio, @jdamgov, @jdolen, @nhanvtran, @gpetruc, @gkasieczka, @schoef, @ferencek, @mverzett, @mariadalfonso, @pvmulder, @seemasharmafnal, @JyothsnaKomaragiri this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@kpedro88
Copy link
Contributor

assign upgrade

@cmsbuild
Copy link
Contributor

New categories assigned: upgrade

@kpedro88 you have been requested to review this Pull request/Issue and eventually sign? Thanks

@kpedro88
Copy link
Contributor

@imarches since this change only targets phase2, it should not modify the settings for other eras. Please restrict this change to be activated by a phase2 era.

@ghost
Copy link
Author

ghost commented Mar 21, 2018

This is on purpose targeting all eras.

The change in #18666 was introduced as, with the Puppi cuts we had at the time, there were some performance gains for Phase 2. No meaningful performance improvement was seen elsewhere and it was extended to all eras just for consistency, as explained in #18426

With the motivation gone for Phase 2 to keep things as in #18666 , there is then no reason to keep that configuration in other eras.

@kpedro88
Copy link
Contributor

Okay, if this is acceptable for BTV then it's the easiest approach.

@kpedro88
Copy link
Contributor

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 21, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/27027/console Started: 2018/03/21 19:09

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-22696/27027/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 244 differences found in the comparisons
  • DQMHistoTests: Total files compared: 29
  • DQMHistoTests: Total histograms compared: 2497880
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2497703
  • DQMHistoTests: Total skipped: 176
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 1.33000000018 KiB( 21 files compared)
  • Checked 118 log files, 9 edm output root files, 29 DQM output files

@kpedro88
Copy link
Contributor

+1
changes limited to slimmedJetsPuppi collections in miniAOD

@slava77
Copy link
Contributor

slava77 commented Mar 23, 2018

+1

for #22696 d6822ae

  • changes are as described
  • jenkins tests pass and comparisons with the baseline show differences only in slimmedJetsPuppi pairDiscriVector data members. The changes have a somewhat common feature with a reduction in the default values of the discriminants. This is expected because we should now be getting more inputs.

Here is one plot for 136.7611 (JetHT Run2016E remini )
all_oldvsnew_runjetht2016ereminiaodwf136p7611c_min2 max-2 patjets_slimmedjetspuppi__pat_obj___pairdiscrivector__11__second

It appears that we still do not have any plots for the puppi jets btagging in the standard DQM.

@fabiocos
Copy link
Contributor

+1

@fabiocos
Copy link
Contributor

merge

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants