Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

non-reproducibility in Tau nano branches #44309

Closed
vlimant opened this issue Mar 5, 2024 · 11 comments
Closed

non-reproducibility in Tau nano branches #44309

vlimant opened this issue Mar 5, 2024 · 11 comments

Comments

@vlimant
Copy link
Contributor

vlimant commented Mar 5, 2024

While we know about #32628 non reproducibility of tau branches came up during a technical PR integration #44295 .
This issue should be tracked down and understood, to make sure there isn't anything else suspicious in the tau branch content.

@vlimant
Copy link
Contributor Author

vlimant commented Mar 5, 2024

type tau

@vlimant
Copy link
Contributor Author

vlimant commented Mar 5, 2024

assign xpog

@vlimant
Copy link
Contributor Author

vlimant commented Mar 5, 2024

assign reconstruction

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 5, 2024

New categories assigned: xpog,reconstruction

@vlimant,@hqucms,@jfernan2,@mandrenguyen you have been requested to review this Pull request/Issue and eventually sign? Thanks

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 5, 2024

cms-bot internal usage

@cmsbuild cmsbuild added the tau label Mar 5, 2024
@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 5, 2024

A new Issue was created by @vlimant.

@smuzaffar, @sextonkennedy, @Dr15Jones, @antoniovilela, @rappoccio, @makortel can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

@vlimant
Copy link
Contributor Author

vlimant commented Mar 5, 2024

in the nano test workflow 2500.01_NANOdata106Xul16v2/all_NANO_step2 plots like
c_TauProd_eta
showed up

@mbluj
Copy link
Contributor

mbluj commented Mar 5, 2024

@vlimant thank you for providing the plot. I will also preform some tests.
One comment and one kind request:

  • The attached plot is for TauProd, i.e. tau object constituents. It could be that the "erase bug fix" by @makortel (Erase from correct vector in PATTauHybridProducer #44067) introduces a small difference in this (here 8 items less over ~23k in total);
  • Is it possible for you to check easly if there is any difference in some Tau object variable, e.g. Tau_eta? It can narrow down area for studies.

@makortel
Copy link
Contributor

makortel commented Mar 5, 2024

The test in #44295 (comment) used CMSSW_14_0_X_2024-03-03-2300. The 14_0_X backport of #44067, i.e. #44272, was merged in CMSSW_14_0_X_2024-03-04-2300, so this hypothesis is possible.

@mbluj
Copy link
Contributor

mbluj commented Mar 5, 2024

I produced NanoAOD on top of 48k semileptonic ttbar events (2018 UL) with the following config:

cmsDriver.py --python_filename nano_cfg.py --eventcontent NANOAODSIM --customise_commands=process.add_(cms.Service('InitRootHandlers',EnableIMT = cms.untracked.bool(False)));process.MessageLogger.cerr.FwkReport.reportEvery=1000 --datatier NANOAODSIM --fileout file:nano.root --conditions auto:phase1_2018_realistic --step NANO --filein file:TTToSemiLeptonic.root --era Run2_2018,run2_nanoAOD_106Xv2 --no_exec --mc -n -1

with the following three software setups:

  • plain CMSSW_14_0_X_2024-03-03-2300
  • above+"erase fix" (commit 5584911)
  • above+"erase fix"+"sorting improvements" (commit 6f6f634).

Then I checked no. of items in Tau and TauProd collections. The former was unchanged while the latter changed by ~1e-4 after introducing "erase fix" and not changed by "sorting improvements". Then I checked that the change is limited to PFGammas for tau candidates built for jets tagged as tau by ParticleNet and not reconstructed by the HPS algorithm. This is exactly the subset of TauProds that could be affected by the "erase fix". For this subset the difference in no. of items is ~1e-3.
As for me the issue is understood.

For reference, the TauProds of interest were selected like this:

Events->Draw("TauProd_pdgId","Tau_idDecayModeNewDMs[TauProd_tauIdx]==0&&abs(TauProd_pdgId)==22","");

@vlimant
Copy link
Contributor Author

vlimant commented Mar 13, 2024

ok, thanks for the check

@vlimant vlimant closed this as completed Mar 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants