Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tau Embedding update and integration #43871

Merged
merged 58 commits into from
May 1, 2024

Conversation

winterchristian
Copy link

PR description:

This PR updates the tau embedding method (TauAnalysis/MCEmbeddingTools) so that it is possible to produce RUN 2 UL tau embedding samples with the newest CMSSW version. The last used working version was CMSSW_10_6_28.
The changes also serve as preparation for the production of RUN 3 tau embedding samples.

The tau embedding method is used to estimate the genuine di-tau background from data. It is a common method used in analyses with tau leptons. More information about tau embedding can be found in the paper: https://doi.org/10.1088/1748-0221/14/06/P06032
In principle, one can split the method into 4 steps, but technically there are at least 6 steps that have to be executed.

In the past, the production of tau embedding samples was always done with a private fork and with institute computation resources. As a long term solution the production will be integrated in central CMS production.

The changes were already presented at tau CQM meetings:
https://indico.cern.ch/event/1366561/#34-integration-of-tau-embeddin
https://indico.cern.ch/event/1301309/#26-tau-embedding-integration-i
And will be presented at a RECO meeting:
https://indico.cern.ch/event/1377565/#15-integration-of-state-of-the

PR validation:

4 unit tests were added which make sure all steps run through for the 4 different data taking periods in RUN 2 UL. At the moment the event files used for this are stored in a private eos directory.

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 5, 2024

cms-bot internal usage

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 5, 2024

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-43871/38717

  • This PR adds an extra 412KB to repository

Code check has found code style and quality issues which could be resolved by applying following patch(s)

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 5, 2024

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-43871/38724

  • This PR adds an extra 184KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 5, 2024

A new Pull Request was created by @winterchristian for master.

It involves the following packages:

  • DataFormats/EgammaCandidates (reconstruction)
  • TauAnalysis/MCEmbeddingTools (simulation)

@mdhildreth, @cmsbuild, @mandrenguyen, @jfernan2, @civanch can you please review it and eventually sign? Thanks.
@a-kapoor, @ram1123, @missirol, @afiqaize, @sameasy, @Sam-Harper, @Prasant1993, @varuns23, @sobhatta, @lgray, @rovere, @jainshilpi this is something you requested to watch as well.
@sextonkennedy, @antoniovilela, @rappoccio you are the release manager for this.

cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 6, 2024

Milestone for this pull request has been moved to CMSSW_14_1_X. Please open a backport if it should also go in to CMSSW_14_0_X.

@cmsbuild cmsbuild modified the milestones: CMSSW_14_0_X, CMSSW_14_1_X Feb 6, 2024
@mandrenguyen
Copy link
Contributor

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 7, 2024

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3fe5f5/37257/summary.html
COMMIT: 00876d8
CMSSW: CMSSW_14_1_X_2024-02-06-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/43871/37257/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 4 errors in the following unit tests:

---> test testTauEmbeddingWorkflow2016preVFP had ERRORS
---> test testTauEmbeddingWorkflow2018 had ERRORS
---> test testTauEmbeddingWorkflow2016postVFP had ERRORS
and more ...

Comparison Summary

Summary:

@mandrenguyen
Copy link
Contributor

please test
Looks like input failures were unrelated

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3fe5f5/38982/summary.html
COMMIT: a8eae9f
CMSSW: CMSSW_14_1_X_2024-04-20-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/43871/38982/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially added 51 lines to the logs
  • Reco comparison results: 50 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3319852
  • DQMHistoTests: Total failures: 9
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3319823
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
  • Checked 202 log files, 165 edm output root files, 48 DQM output files
  • TriggerResults: no differences found

@mandrenguyen
Copy link
Contributor

type tau

@cmsbuild cmsbuild added the tau label Apr 22, 2024
@mandrenguyen
Copy link
Contributor

+reconstruction
This code integrates tau embedding into cmssw.
Authors can consider adding a relval workflow in the future in case centralized production is envisaged.

@civanch Simulation will have to re-sign.

@civanch
Copy link
Contributor

civanch commented Apr 30, 2024

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @antoniovilela, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

@rappoccio
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 6b15a09 into cms-sw:master May 1, 2024
11 checks passed
<class name="std::vector<edm::RefVector<std::vector<reco::GsfTrack>,reco::GsfTrack,edm::refhelper::FindUsingAdvance<std::vector<reco::GsfTrack>,reco::GsfTrack> > >"/>
<class name="edm::Wrapper<edm::RefVector<std::vector<reco::GsfTrack>,reco::GsfTrack,edm::refhelper::FindUsingAdvance<std::vector<reco::GsfTrack>,reco::GsfTrack> > >"/>
<class name="std::vector<edm::Ref<std::vector<reco::GsfTrack>,reco::GsfTrack,edm::refhelper::FindUsingAdvance<std::vector<reco::GsfTrack>,reco::GsfTrack> > >"/>

Copy link
Contributor

@smuzaffar smuzaffar May 2, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@winterchristian , normally GsfTrackReco type dictionaries should go in to DataFormats/GsfTrackReco. Any specific reason to add these dict in DataFormats/EgammaCandidates package?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@cms-sw/reconstruction-l2 any objections on moving these to DataFormats/GsfTrackReco ?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No objection. Sorry we missed it.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same from us (answering for @winterchristian since he is on holiday)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done in #44884

@antoniovilela
Copy link
Contributor

@makortel
Copy link
Contributor

makortel commented May 3, 2024

Also a configuration problem, see #44896 for more details

@jfernan2
Copy link
Contributor

jfernan2 commented May 9, 2024

It is being fixed on #44928

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

10 participants