upgrade pythia8 to 303 #6286

mkirsano · 2020-10-01T16:45:07Z

No description provided.

cmsbuild · 2020-10-01T16:45:25Z

A new Pull Request was created by @mkirsano (Mikhail Kirsanov) for branch IB/CMSSW_11_2_X/master.

@cmsbuild, @smuzaffar, @mrodozov can you please review it and eventually sign? Thanks.
cms-bot commands are listed here

mkirsano · 2020-10-01T16:48:13Z

please test

cmsbuild · 2020-10-01T16:48:33Z

The tests are being triggered in jenkins.

CMSSW_11_2_X_2020-10-01-1100/slc7_amd64_gcc820: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/9688/console Started: 2020/10/01 18:49

cmsbuild · 2020-10-01T18:45:51Z

-1

Tested at: c5613e7

CMSSW: CMSSW_11_2_X_2020-10-01-1100
SCRAM_ARCH: slc7_amd64_gcc820
You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6b5e61/9688/summary.html

I found follow errors while testing this PR

Failed tests: UnitTests RelVals AddOn

Unit Tests:

I found errors in the following unit tests:

---> test GeneratorInterfaceEvtGenInterfaceTest had ERRORS
---> test testTauEmbeddingProducers had ERRORS

RelVals:

When I ran the RelVals I found an error in the following workflows:
25.0 step1

runTheMatrix-results/25.0_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT/step1_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT.log

135.4 step1

runTheMatrix-results/135.4_ZEE_13+ZEEFS_13+HARVESTUP15FS+MINIAODMCUP15FS/step1_ZEE_13+ZEEFS_13+HARVESTUP15FS+MINIAODMCUP15FS.log

5.1 step1

runTheMatrix-results/5.1_TTbar+TTbarFS+HARVESTFS/step1_TTbar+TTbarFS+HARVESTFS.log

1330.0 step1

runTheMatrix-results/1330.0_ZMM_13+ZMM_13+DIGIUP15+RECOUP15_L1TMuDQM+HARVESTUP15_L1TMuDQM+NANOUP15/step1_ZMM_13+ZMM_13+DIGIUP15+RECOUP15_L1TMuDQM+HARVESTUP15_L1TMuDQM+NANOUP15.log

25202.0 step1

runTheMatrix-results/25202.0_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25+NANOUP15_PU25/step1_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25+NANOUP15_PU25.log

10024.0 step1

runTheMatrix-results/10024.0_TTbar_13+2017+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT+ALCA+Nano/step1_TTbar_13+2017+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT+ALCA+Nano.log

10042.0 step1

runTheMatrix-results/10042.0_ZMM_13+2017+ZMM_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT+ALCA+Nano/step1_ZMM_13+2017+ZMM_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT+ALCA+Nano.log

10224.0 step1

runTheMatrix-results/10224.0_TTbar_13+2017PU+TTbar_13TeV_TuneCUETP8M1_GenSim+DigiPU+RecoFakeHLTPU+HARVESTFakeHLTPU+Nano/step1_TTbar_13+2017PU+TTbar_13TeV_TuneCUETP8M1_GenSim+DigiPU+RecoFakeHLTPU+HARVESTFakeHLTPU+Nano.log

10824.0 step1

runTheMatrix-results/10824.0_TTbar_13+2018+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT+ALCA+Nano/step1_TTbar_13+2018+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+RecoFakeHLT+HARVESTFakeHLT+ALCA+Nano.log

11634.0 step1

runTheMatrix-results/11634.0_TTbar_14TeV+2021+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST+ALCA/step1_TTbar_14TeV+2021+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST+ALCA.log

12434.0 step1

runTheMatrix-results/12434.0_TTbar_14TeV+2023+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST+ALCA/step1_TTbar_14TeV+2023+TTbar_14TeV_TuneCP5_GenSim+Digi+Reco+HARVEST+ALCA.log

23234.0 step1

runTheMatrix-results/23234.0_TTbar_14TeV+2026D49+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal/step1_TTbar_14TeV+2026D49+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal.log

23434.999 step1

runTheMatrix-results/23434.999_TTbar_14TeV+2026D49PU_PMXS1S2PR+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+PREMIX_PremixHLBeamSpot14PU+DigiTriggerPU+RecoGlobalPU+HARVESTGlobalPU/step1_TTbar_14TeV+2026D49PU_PMXS1S2PR+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+PREMIX_PremixHLBeamSpot14PU+DigiTriggerPU+RecoGlobalPU+HARVESTGlobalPU.log

250202.181 step1

runTheMatrix-results/250202.181_TTbar_13UP18+TTbar_13UP18+PREMIXUP18_PU25+DIGIPRMXLOCALUP18_PU25+RECOPRMXUP18_PU25+HARVESTUP18_PU25/step1_TTbar_13UP18+TTbar_13UP18+PREMIXUP18_PU25+DIGIPRMXLOCALUP18_PU25+RECOPRMXUP18_PU25+HARVESTUP18_PU25.log

28234.0 step1

runTheMatrix-results/28234.0_TTbar_14TeV+2026D60+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal/step1_TTbar_14TeV+2026D60+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal.log

AddOn:

I found errors in the following addon tests:

cmsDriver.py TTbar_8TeV_TuneCUETP8M1_cfi --conditions auto:run1_mc --fast -n 100 --eventcontent AODSIM,DQM --relval 100000,1000 -s GEN,SIM,RECOBEFMIX,DIGI:pdigi_valid,L1,DIGI2RAW,L1Reco,RECO,EI,VALIDATION --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --datatier GEN-SIM-DIGI-RECO,DQMIO --beamspot Realistic8TeVCollision : FAILED - time: date Thu Oct 1 20:32:29 2020-date Thu Oct 1 20:30:16 2020 s - exit: 16640
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run3_mc_GRun --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run3 --fileout file:RelVal_Raw_GRun_MC.root : FAILED - time: date Thu Oct 1 20:40:24 2020-date Thu Oct 1 20:30:38 2020 s - exit: 16640
cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi --conditions auto:run2_mc_l1stage1 --fast -n 100 --eventcontent AODSIM,DQM --relval 100000,1000 -s GEN,SIM,RECOBEFMIX,DIGI:pdigi_valid,L1,DIGI2RAW,L1Reco,RECO,EI,VALIDATION --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --datatier GEN-SIM-DIGI-RECO,DQMIO --beamspot NominalCollision2015 --era Run2_25ns : FAILED - time: date Thu Oct 1 20:33:11 2020-date Thu Oct 1 20:30:41 2020 s - exit: 16640
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run3_mc_PRef --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run3 --fileout file:RelVal_Raw_PRef_MC.root : FAILED - time: date Thu Oct 1 20:35:59 2020-date Thu Oct 1 20:30:42 2020 s - exit: 16640
cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi --conditions auto:run2_mc --fast -n 100 --eventcontent AODSIM,DQM --relval 100000,1000 -s GEN,SIM,RECOBEFMIX,DIGI:pdigi_valid,L1,DIGI2RAW,L1Reco,RECO,EI,VALIDATION --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --datatier GEN-SIM-DIGI-RECO,DQMIO --beamspot NominalCollision2015 --era Run2_2016 : FAILED - time: date Thu Oct 1 20:33:25 2020-date Thu Oct 1 20:30:46 2020 s - exit: 16640
cmsDriver.py TTbar_Tauola_8TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run1_mc_Fake --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --fileout file:RelVal_Raw_Fake_MC.root : FAILED - time: date Thu Oct 1 20:35:29 2020-date Thu Oct 1 20:30:49 2020 s - exit: 16640
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run3_mc_HIon --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run3_pp_on_PbPb --fileout file:RelVal_Raw_HIon_MC.root : FAILED - time: date Thu Oct 1 20:36:54 2020-date Thu Oct 1 20:30:52 2020 s - exit: 16640
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run2_mc_Fake2 --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2016 --fileout file:RelVal_Raw_Fake2_MC.root : FAILED - time: date Thu Oct 1 20:35:37 2020-date Thu Oct 1 20:30:56 2020 s - exit: 16640
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run2_mc_Fake1 --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_25ns --fileout file:RelVal_Raw_Fake1_MC.root : FAILED - time: date Thu Oct 1 20:35:49 2020-date Thu Oct 1 20:30:57 2020 s - exit: 16640
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run3_mc_PIon --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run3 --fileout file:RelVal_Raw_PIon_MC.root : FAILED - time: date Thu Oct 1 20:37:25 2020-date Thu Oct 1 20:32:35 2020 s - exit: 16640

cmsbuild · 2020-10-01T18:45:53Z

Comparison not run due to runTheMatrix errors (RelVals and Igprof tests were also skipped)

mkirsano · 2020-10-07T20:37:18Z

please test with cms-sw/cmssw#31705

cmsbuild · 2020-10-07T20:37:43Z

The tests are being triggered in jenkins.
Tested with other pull request(s) cms-sw/cmssw#31705

CMSSW_11_2_X_2020-10-07-1100/slc7_amd64_gcc820: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/9791/console Started: 2020/10/07 22:38

cmsbuild · 2020-10-07T22:59:34Z

-1

Tested at: c5613e7

CMSSW: CMSSW_11_2_X_2020-10-07-1100
SCRAM_ARCH: slc7_amd64_gcc820
You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-64e270/9791/summary.html

I found follow errors while testing this PR

Failed tests: UnitTests

Unit Tests:

I found errors in the following unit tests:

---> test GeneratorInterfaceEvtGenInterfaceTest had ERRORS
---> test testTauEmbeddingProducers had ERRORS

cmsbuild · 2020-10-07T22:59:39Z

Comparison job queued.

cmsbuild · 2020-11-19T16:04:16Z

The tests are being triggered in jenkins.
Tested with other pull request(s) cms-sw/cmssw#31816,#6411

CMSSW_11_2_X_2020-11-19-1100/slc7_amd64_gcc820: https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/10857/console Started: 2020/11/19 17:06

cmsbuild · 2020-11-19T18:54:55Z

+1
Tested at: c5613e7
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-54f75d/10857/summary.html
CMSSW: CMSSW_11_2_X_2020-11-19-1100
SCRAM_ARCH: slc7_amd64_gcc820

cmsbuild · 2020-11-19T18:55:04Z

Comparison job queued.

cmsbuild · 2020-11-20T02:42:28Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-54f75d/10857/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-54f75d/11624.911_TTbar_13+2021_DD4hep+TTbar_13TeV_TuneCUETP8M1_GenSim+Digi+Reco+HARVEST+ALCA
/build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-54f75d/11642.911_ZMM_13+2021_DD4hep+ZMM_13TeV_TuneCUETP8M1_GenSim+Digi+Reco+HARVEST+ALCA

Comparison Summary:

No significant changes to the logs found
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 42777 differences found in the comparisons
DQMHistoTests: Total files compared: 37
DQMHistoTests: Total histograms compared: 2960080
DQMHistoTests: Total failures: 634128
DQMHistoTests: Total nulls: 167
DQMHistoTests: Total successes: 2325763
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -639.842 KiB( 36 files compared)
DQMHistoSizes: changed ( 10224.0 ): 0.762 KiB SiStrip/MechanicalView
DQMHistoSizes: changed ( 11624.911 ): 468.646 KiB HLT/HLTEgammaValidation
DQMHistoSizes: changed ( 11634.0,... ): -555.274 KiB HLT/HLTEgammaValidation
DQMHistoSizes: changed ( 250202.181 ): 1.246 KiB SiStrip/MechanicalView
DQMHistoSizes: changed ( 25202.0 ): 0.052 KiB SiStrip/MechanicalView
Checked 158 log files, 34 edm output root files, 37 DQM output files

silviodonato · 2020-11-20T08:14:28Z

@mrodozov @cms-sw/generators-l2 I think the changes are just statistic fluctuations due to the new generator. I don't know if you usually require a full validation from @cms-sw/pdmv-l2 for pythia updates.

agrohsje · 2020-11-20T08:29:34Z

Hi @silviodonato . Indeed, as you always expect changes by changing versions, it would be useful to run some dedicated comparison campaign, check the differences and make sure they map our expectations from the P8 logs. This would also help to spot unexpected behaviour.

mrodozov · 2020-11-20T08:48:21Z

+externals
the external is integrating, if you say the comparison is reasonable - we get it in

cmsbuild · 2020-11-20T08:48:45Z

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_11_2_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

chayanit · 2020-11-20T10:48:12Z

@silviodonato , the validation on generators are done in every campaign separately by GEN-only workflows but thanks for pointing this out as we will also have to provide RECO-only workflows to RECO validators in order to disentangle the generator effects. Is this coming in the next pre release?

silviodonato · 2020-11-20T13:55:23Z

Thanks @chayanit . I think we can include this PR in the prerelease. @cms-sw/generators-l2 do you agree?

@cms-sw/generators-l2 I have a further question about the comparison (#6286 (comment)): do you know why some plots have disappeared?
For instance: plot HLT/HLTEgammaValidation/EfficiencyByPath_Ele in wf 12434.0 (see https://tinyurl.com/yxd6d7c5 )

agrohsje · 2020-11-20T14:35:29Z

Hi @silviodonato . Looks good to me.

silviodonato · 2020-11-20T16:07:19Z

+1

upgrade pythia8 to 303

c5613e7

cmsbuild added comparison-pending externals-pending orp-pending pending-signatures tests-pending labels Oct 1, 2020

cmsbuild added tests-started and removed tests-pending labels Oct 1, 2020

cmsbuild added comparison-notrun tests-rejected and removed comparison-pending tests-started labels Oct 1, 2020

cmsbuild added comparison-pending tests-pending and removed comparison-notrun tests-rejected labels Oct 7, 2020

cmsbuild mentioned this pull request Oct 7, 2020

remove inexistent pythia8 parameter from config cms-sw/cmssw#31705

Merged

cmsbuild added requires-external tests-started and removed tests-pending labels Oct 7, 2020

cmsbuild removed the tests-started label Oct 7, 2020

cmsbuild added comparison-pending tests-pending and removed comparison-available tests-approved labels Nov 19, 2020

cmsbuild mentioned this pull request Nov 19, 2020

Update tag for GeneratorInterface-EvtGenInterface to V02-01-00 #6411

Merged

cmsbuild added tests-started and removed tests-pending labels Nov 19, 2020

cmsbuild added tests-approved and removed tests-started labels Nov 19, 2020

cmsbuild added comparison-available and removed comparison-pending labels Nov 20, 2020

cmsbuild added externals-approved fully-signed and removed externals-pending pending-signatures labels Nov 20, 2020

cmsbuild added orp-approved and removed orp-pending labels Nov 20, 2020

cmsbuild merged commit 76d01f2 into cms-sw:IB/CMSSW_11_2_X/master Nov 20, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

upgrade pythia8 to 303 #6286

upgrade pythia8 to 303 #6286

mkirsano commented Oct 1, 2020

cmsbuild commented Oct 1, 2020

mkirsano commented Oct 1, 2020

cmsbuild commented Oct 1, 2020 •

edited

Loading

cmsbuild commented Oct 1, 2020

cmsbuild commented Oct 1, 2020

mkirsano commented Oct 7, 2020

cmsbuild commented Oct 7, 2020 •

edited

Loading

cmsbuild commented Oct 7, 2020

cmsbuild commented Oct 7, 2020

cmsbuild commented Nov 19, 2020 •

edited

Loading

cmsbuild commented Nov 19, 2020

cmsbuild commented Nov 19, 2020

cmsbuild commented Nov 20, 2020

silviodonato commented Nov 20, 2020

agrohsje commented Nov 20, 2020

mrodozov commented Nov 20, 2020

cmsbuild commented Nov 20, 2020

chayanit commented Nov 20, 2020

silviodonato commented Nov 20, 2020

agrohsje commented Nov 20, 2020

silviodonato commented Nov 20, 2020

upgrade pythia8 to 303 #6286

upgrade pythia8 to 303 #6286

Conversation

mkirsano commented Oct 1, 2020

cmsbuild commented Oct 1, 2020

mkirsano commented Oct 1, 2020

cmsbuild commented Oct 1, 2020 • edited Loading

cmsbuild commented Oct 1, 2020

cmsbuild commented Oct 1, 2020

mkirsano commented Oct 7, 2020

cmsbuild commented Oct 7, 2020 • edited Loading

cmsbuild commented Oct 7, 2020

cmsbuild commented Oct 7, 2020

cmsbuild commented Nov 19, 2020 • edited Loading

cmsbuild commented Nov 19, 2020

cmsbuild commented Nov 19, 2020

cmsbuild commented Nov 20, 2020

silviodonato commented Nov 20, 2020

agrohsje commented Nov 20, 2020

mrodozov commented Nov 20, 2020

cmsbuild commented Nov 20, 2020

chayanit commented Nov 20, 2020

silviodonato commented Nov 20, 2020

agrohsje commented Nov 20, 2020

silviodonato commented Nov 20, 2020

cmsbuild commented Oct 1, 2020 •

edited

Loading

cmsbuild commented Oct 7, 2020 •

edited

Loading

cmsbuild commented Nov 19, 2020 •

edited

Loading