Add 2024 FastSim workflow #46068

srimanob · 2024-09-19T23:17:53Z

PR description:

Add 2024 FastSim workflow. This PR used PU dataset from 2023FSPU first, and will update when 2024FSPU is available.

PR validation:

Test with workflow 16434.0

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

To be backport to the release of 2024 MC

cmsbuild · 2024-09-19T23:18:20Z

cms-bot internal usage

cmsbuild · 2024-09-19T23:20:03Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-46068/41858

There are other open Pull requests which might conflict with changes you have proposed:
- File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): Add run3 tracking low pu era #33532, CMSSW Integration of LST #45117, Introduce support for cluster splitting and JetCore iteration in Phase-2 track reconstruction #46001, FastSim premixing workflows and matrix cleanup #46007, Enable DNN supercluster in Phase2 HLT #46010, add variants to the phase-2 relval workflow running the HLT timing menu, up to step2 #46064

cmsbuild · 2024-09-19T23:20:27Z

A new Pull Request was created by @srimanob for master.

It involves the following packages:

Configuration/PyReleaseValidation (upgrade, pdmv)

@AdrianoDee, @Moanwar, @cmsbuild, @kskovpen, @miquork, @srimanob, @subirsarkar, @sunilUIET can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @fabiocos, @makortel, @missirol, @slomeo this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

cmsbuild · 2024-09-19T23:28:55Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-46068/41859

There are other open Pull requests which might conflict with changes you have proposed:
- File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): Add run3 tracking low pu era #33532, CMSSW Integration of LST #45117, Introduce support for cluster splitting and JetCore iteration in Phase-2 track reconstruction #46001, FastSim premixing workflows and matrix cleanup #46007, Enable DNN supercluster in Phase2 HLT #46010, add variants to the phase-2 relval workflow running the HLT timing menu, up to step2 #46064

cmsbuild · 2024-09-19T23:29:19Z

Pull request #46068 was updated. @AdrianoDee, @Moanwar, @cmsbuild, @kskovpen, @miquork, @srimanob, @subirsarkar, @sunilUIET can you please check and sign again.

srimanob · 2024-09-19T23:31:57Z

Hi @AdrianoDee

In #44075, you add 2024 FastSim workflows (14434.0, 14634.0, 14440.303), but those ID were not for FastSim. Is it just a bug in that PR?

srimanob · 2024-09-19T23:50:01Z

test parameters:

workflows = 16434.0, 16634.0, 16440.303
relvals_opt = --what cleanedupgrade,standard,highstats,pileup,generator,extendedgen,production,identity,ged,machine,premix,nano,gpu,2017,2026

cmsbuild · 2024-09-19T23:52:34Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-46068/41860

There are other open Pull requests which might conflict with changes you have proposed:
- File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): Add run3 tracking low pu era #33532, CMSSW Integration of LST #45117, Introduce support for cluster splitting and JetCore iteration in Phase-2 track reconstruction #46001, FastSim premixing workflows and matrix cleanup #46007, Enable DNN supercluster in Phase2 HLT #46010, add variants to the phase-2 relval workflow running the HLT timing menu, up to step2 #46064

cmsbuild · 2024-09-19T23:52:59Z

Pull request #46068 was updated. @AdrianoDee, @Moanwar, @cmsbuild, @kskovpen, @miquork, @srimanob, @subirsarkar, @sunilUIET can you please check and sign again.

srimanob · 2024-09-20T00:03:24Z

@cmsbuild please test

srimanob · 2024-09-21T21:51:43Z

+Upgrade

All new 2024 FastSim workflow run fine.

FYI @sbein @kpedro88

srimanob · 2024-10-02T13:38:33Z

@cmsbuild please test

srimanob · 2024-10-02T13:38:49Z

Kindly ping @cms-sw/pdmv-l2

AdrianoDee · 2024-10-02T13:44:02Z

Configuration/PyReleaseValidation/python/relval_steps.py

@@ -4377,6 +4377,7 @@ def gen2024HiMix(fragment,howMuch):
 defaultDataSets['2024']='CMSSW_14_0_0_pre3-140X_mcRun3_2024_realistic_v1_STD_2024_noPU-v'
 defaultDataSets['2024HLTOnDigi']='CMSSW_14_0_0_pre3-140X_mcRun3_2024_realistic_v1_STD_2024_noPU-v'
 defaultDataSets["2024SimOnGen"] = 'CMSSW_14_0_0_pre3-140X_mcRun3_2024_realistic_v1_STD_2024_noPU-v'
+defaultDataSets['2024FS']='CMSSW_13_0_11-130X_mcRun3_2023_realistic_withEarly2023BS_v1_FastSim-v' #To replace with new dataset


Hi @srimanob if it is useful to have a new production let us know on JIRA and we can organize this :-)

AdrianoDee · 2024-10-02T13:45:34Z

+pdmv
(failures un-related)

cmsbuild · 2024-10-02T13:45:56Z

This pull request is fully signed and it will be integrated in one of the next master IBs after it passes the integration tests. This pull request will now be reviewed by the release team before it's merged. @rappoccio, @antoniovilela, @sextonkennedy, @mandrenguyen (and backports should be raised in the release meeting by the corresponding L2)

cmsbuild · 2024-10-02T17:28:51Z

+1

Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-21ca59/41883/summary.html
COMMIT: 0c0a407
CMSSW: CMSSW_14_2_X_2024-10-02-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46068/41883/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially removed 1 lines from the logs
Reco comparison results: 51 differences found in the comparisons
DQMHistoTests: Total files compared: 44
DQMHistoTests: Total histograms compared: 3331342
DQMHistoTests: Total failures: 3731
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3327591
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 43 files compared)
Checked 193 log files, 163 edm output root files, 44 DQM output files
TriggerResults: no differences found

srimanob · 2024-10-02T17:47:14Z

Failure does not relate to this PR.

mandrenguyen · 2024-10-02T19:14:17Z

+1

Add 2024FS

82d8694

cmsbuild added this to the CMSSW_14_2_X milestone Sep 19, 2024

cmsbuild added pending-signatures tests-pending orp-pending pdmv-pending upgrade-pending code-checks-pending labels Sep 19, 2024

cmsbuild added code-checks-approved and removed code-checks-pending labels Sep 19, 2024

Fix wf ID

4211218

cmsbuild added code-checks-pending and removed code-checks-approved labels Sep 19, 2024

cmsbuild added code-checks-approved and removed code-checks-pending labels Sep 19, 2024

update temporary PU

0c0a407

cmsbuild added code-checks-pending and removed code-checks-approved labels Sep 19, 2024

cmsbuild added code-checks-approved and removed code-checks-pending labels Sep 19, 2024

cmsbuild added tests-rejected and removed tests-started labels Sep 20, 2024

cmsbuild added upgrade-approved and removed upgrade-pending labels Sep 21, 2024

cmsbuild added tests-started and removed tests-rejected labels Oct 2, 2024

AdrianoDee reviewed Oct 2, 2024

View reviewed changes

cmsbuild added fully-signed pdmv-approved and removed pending-signatures pdmv-pending labels Oct 2, 2024

cmsbuild added tests-approved and removed tests-started labels Oct 2, 2024

cmsbuild added orp-approved and removed orp-pending labels Oct 2, 2024

cmsbuild merged commit 7d1afdf into cms-sw:master Oct 2, 2024
12 checks passed

cmsbuild mentioned this pull request Oct 2, 2024

[NanoAOD] Add ParticleNet-based Muon ID #46153

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add 2024 FastSim workflow #46068

Add 2024 FastSim workflow #46068

srimanob commented Sep 19, 2024 •

edited

Loading

cmsbuild commented Sep 19, 2024 •

edited

Loading

cmsbuild commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

srimanob commented Sep 19, 2024

srimanob commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

srimanob commented Sep 20, 2024

srimanob commented Sep 21, 2024

srimanob commented Oct 2, 2024

srimanob commented Oct 2, 2024

AdrianoDee Oct 2, 2024

AdrianoDee commented Oct 2, 2024

cmsbuild commented Oct 2, 2024

cmsbuild commented Oct 2, 2024

srimanob commented Oct 2, 2024

mandrenguyen commented Oct 2, 2024

Add 2024 FastSim workflow #46068

Add 2024 FastSim workflow #46068

Conversation

srimanob commented Sep 19, 2024 • edited Loading

PR description:

PR validation:

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

cmsbuild commented Sep 19, 2024 • edited Loading

cmsbuild commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

srimanob commented Sep 19, 2024

srimanob commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

srimanob commented Sep 20, 2024

srimanob commented Sep 21, 2024

srimanob commented Oct 2, 2024

srimanob commented Oct 2, 2024

AdrianoDee Oct 2, 2024

Choose a reason for hiding this comment

AdrianoDee commented Oct 2, 2024

cmsbuild commented Oct 2, 2024

cmsbuild commented Oct 2, 2024

Comparison Summary

srimanob commented Oct 2, 2024

mandrenguyen commented Oct 2, 2024

srimanob commented Sep 19, 2024 •

edited

Loading

cmsbuild commented Sep 19, 2024 •

edited

Loading