Addition of workflow for release validation with data #39265

sunilUIET · 2022-08-31T12:19:26Z

PR description:

This PR is for the addition of Run3 WFs (140.003 - 140.005, 140.015 - 140.020, 140.031 - 140.036) for the release validation with data

PR validation:

Changes have been on top of CMSSW_12_6_0_pre1 and the aforementioned WFs are tested using
runTheMatrix.py --what standard -l 140.003,140.004,140.005,140.015,140.016,140.017,140.018,140.019,140.020,140.031,140.032,140.033,140.034,140.035,140.036 -t 4 --command='-n 10'

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

Not a backport

cmsbuild · 2022-08-31T12:25:09Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-39265/31914

This PR adds an extra 60KB to repository

cmsbuild · 2022-08-31T12:25:31Z

A new Pull Request was created by @sunilUIET (sunil bansal) for master.

It involves the following packages:

Configuration/PyReleaseValidation (pdmv, upgrade)

@jordan-martins, @bbilin, @cmsbuild, @AdrianoDee, @srimanob, @kskovpen can you please review it and eventually sign? Thanks.
@makortel, @kpedro88, @fabiocos, @Martin-Grunewald, @missirol, @trtomei, @beaucero, @slomeo this is something you requested to watch as well.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.

cms-bot commands are listed here

srimanob · 2022-08-31T13:46:25Z

test parameters:

workflows = 140.003,140.004,140.005,140.015,140.016,140.017,140.018,140.019,140.020,140.031,140.032,140.033,140.034,140.035,140.036

srimanob · 2022-08-31T13:48:01Z

Configuration/PyReleaseValidation/python/relval_standard.py

@@ -457,8 +457,26 @@
 workflows[139.005] = ['',['AlCaPhiSym2021','RECOALCAECALPHISYMDR3','ALCAECALPHISYM']]

 ### run3 (2022) ###
-workflows[140.001] = ['',['RunMinimumBias2022B','HLTRUN3','RECONANORUN3','HARVESTRUN3']]
-workflows[140.002] = ['',['RunZeroBias2022B','HLTRUN3','RECONANORUN3','HARVESTRUN3']]
+workflows[140.001] = ['',['RunZeroBias2022B','HLTRUN3','RECONANORUN3','HARVESTRUN3']]


Do we need to switch the workflow of ZeroBias and MinBias here?

No, actually this is totally accidental and realized after creating PR.

OK, Please fix. Thanks.

@srimanob I made the changes. Please see if these are correctly propagated to the PR.

srimanob · 2022-08-31T13:48:23Z

@cmsbuild please test

cmsbuild · 2022-08-31T16:59:57Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-39265/31926

This PR adds an extra 20KB to repository

cmsbuild · 2022-08-31T17:00:27Z

Pull request #39265 was updated. @bbilin, @cmsbuild, @AdrianoDee, @srimanob, @kskovpen, @sunilUIET can you please check and sign again.

srimanob · 2022-08-31T17:01:25Z

@cmsbuild please test

cmsbuild · 2022-08-31T21:28:44Z

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b32d18/27236/summary.html
COMMIT: 87a6342
CMSSW: CMSSW_12_6_X_2022-08-31-1100/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/39265/27236/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

140.56140.56_RunHI2018+RunHI2018+RECOHID18+HARVESTDHI18/step2_RunHI2018+RunHI2018+RECOHID18+HARVESTDHI18.log
1001.21001.2_RunZeroBias2017F+RunZeroBias2017F+TIER0EXPRUN2+ALCAEXPRUN2+ALCAHARVDSIPIXELCAL+ALCAHARVDSIPIXELCALLA+ALCAHARVD4+ALCAHARVDSIPIXELALIHG/step2_RunZeroBias2017F+RunZeroBias2017F+TIER0EXPRUN2+ALCAEXPRUN2+ALCAHARVDSIPIXELCAL+ALCAHARVDSIPIXELCALLA+ALCAHARVD4+ALCAHARVDSIPIXELALIHG.log
1002.41002.4_RunDoubleMuon2022B+RunDoubleMuon2022B+TIER0PROMPTRUN3+HARVESTPROMPTRUN3/step2_RunDoubleMuon2022B+RunDoubleMuon2022B+TIER0PROMPTRUN3+HARVESTPROMPTRUN3.log

Expand to see more relval errors ...

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.003_RunJetHT2022B+RunJetHT2022B+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.004_RunEGamma2022B+RunEGamma2022B+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.005_RunSingleMuon2022B+RunSingleMuon2022B+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.015_RunZeroBias2022C+RunZeroBias2022C+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.016_RunJetMET2022C+RunJetMET2022C+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.017_RunEGamma2022C+RunEGamma2022C+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.018_RunMuon2022C+RunMuon2022C+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.019_RunTau2022C+RunTau2022C+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.02_RunBTagMu2022C+RunBTagMu2022C+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.031_RunZeroBias2022D+RunZeroBias2022D+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.032_RunJetMET2022D+RunJetMET2022D+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.033_RunEGamma2022D+RunEGamma2022D+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.034_RunMuon2022D+RunMuon2022D+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.035_RunTau2022D+RunTau2022D+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.036_RunBTagMu2022D+RunBTagMu2022D+HLTRUN3+RECONANORUN3+HARVESTRUN3

Summary:

No significant changes to the logs found
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 51
DQMHistoTests: Total histograms compared: 3620448
DQMHistoTests: Total failures: 16
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3620410
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 50 files compared)
Checked 212 log files, 49 edm output root files, 51 DQM output files
TriggerResults: no differences found

srimanob · 2022-09-01T01:09:40Z

It seems to be a glitch on PR test, not relate to this PR. The issue on RelVal-INPUT, as I see 2 of them, they found the file, but did not run until the end.

srimanob · 2022-09-01T01:10:04Z

@cmsbuild please test

To see if we can clean up the relval-input issue.

cmsbuild · 2022-09-01T07:32:04Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b32d18/27247/summary.html
COMMIT: 87a6342
CMSSW: CMSSW_12_6_X_2022-08-31-2300/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/39265/27247/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.003_RunJetHT2022B+RunJetHT2022B+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.004_RunEGamma2022B+RunEGamma2022B+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.005_RunSingleMuon2022B+RunSingleMuon2022B+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.015_RunZeroBias2022C+RunZeroBias2022C+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.016_RunJetMET2022C+RunJetMET2022C+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.017_RunEGamma2022C+RunEGamma2022C+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.018_RunMuon2022C+RunMuon2022C+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.019_RunTau2022C+RunTau2022C+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.02_RunBTagMu2022C+RunBTagMu2022C+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.031_RunZeroBias2022D+RunZeroBias2022D+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.032_RunJetMET2022D+RunJetMET2022D+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.033_RunEGamma2022D+RunEGamma2022D+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.034_RunMuon2022D+RunMuon2022D+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.035_RunTau2022D+RunTau2022D+HLTRUN3+RECONANORUN3+HARVESTRUN3
/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-b32d18/140.036_RunBTagMu2022D+RunBTagMu2022D+HLTRUN3+RECONANORUN3+HARVESTRUN3

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 51
DQMHistoTests: Total histograms compared: 3620448
DQMHistoTests: Total failures: 14
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3620412
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 50 files compared)
Checked 212 log files, 49 edm output root files, 51 DQM output files
TriggerResults: no differences found

srimanob · 2022-09-01T07:33:10Z

+Upgrade

New data workflows run fine.

kskovpen · 2022-09-01T07:41:04Z

+pdmv

Thanks @srimanob for the prompt review!

cmsbuild · 2022-09-01T07:41:30Z

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

perrotta · 2022-09-01T08:37:20Z

+1

sunilUIET added 2 commits August 31, 2022 08:13

WFs additions

3ff9b2d

WFs addition

f586402

cmsbuild added this to the CMSSW_12_6_X milestone Aug 31, 2022

cmsbuild added code-checks-pending orp-pending pdmv-pending pending-signatures tests-pending upgrade-pending labels Aug 31, 2022

cmsbuild added code-checks-approved and removed code-checks-pending labels Aug 31, 2022

srimanob reviewed Aug 31, 2022

View reviewed changes

cmsbuild added tests-started and removed tests-pending labels Aug 31, 2022

switched MB ad ZB

87a6342

cmsbuild added code-checks-pending tests-pending and removed tests-started code-checks-approved labels Aug 31, 2022

cmsbuild added code-checks-approved and removed code-checks-pending labels Aug 31, 2022

cmsbuild added tests-started and removed tests-pending labels Aug 31, 2022

cmsbuild added tests-rejected and removed tests-started labels Aug 31, 2022

cmsbuild added tests-started and removed tests-rejected labels Sep 1, 2022

cmsbuild added tests-approved and removed tests-started labels Sep 1, 2022

cmsbuild added upgrade-approved and removed upgrade-pending labels Sep 1, 2022

cmsbuild added fully-signed pdmv-approved and removed pending-signatures pdmv-pending labels Sep 1, 2022

cmsbuild added orp-approved and removed orp-pending labels Sep 1, 2022

cmsbuild merged commit 28cb299 into cms-sw:master Sep 1, 2022

This was referenced Sep 1, 2022

[llvm] Update to version 14.0.6 cms-sw/cmsdist#7729

Closed

[G4VECGEOM] Update geant4 to 11.0.7 and dd4hep to 01.22 cms-sw/cmsdist#8055

Merged

kskovpen mentioned this pull request Oct 18, 2022

Update Run2022 relval wfs #39755

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Addition of workflow for release validation with data #39265

Addition of workflow for release validation with data #39265

sunilUIET commented Aug 31, 2022

cmsbuild commented Aug 31, 2022

cmsbuild commented Aug 31, 2022

srimanob commented Aug 31, 2022

srimanob Aug 31, 2022 •

edited

Loading

sunilUIET Aug 31, 2022

srimanob Aug 31, 2022

sunilUIET Aug 31, 2022

srimanob commented Aug 31, 2022

cmsbuild commented Aug 31, 2022

cmsbuild commented Aug 31, 2022

srimanob commented Aug 31, 2022

cmsbuild commented Aug 31, 2022

srimanob commented Sep 1, 2022

srimanob commented Sep 1, 2022

cmsbuild commented Sep 1, 2022

srimanob commented Sep 1, 2022

kskovpen commented Sep 1, 2022

cmsbuild commented Sep 1, 2022

perrotta commented Sep 1, 2022

Addition of workflow for release validation with data #39265

Addition of workflow for release validation with data #39265

Conversation

sunilUIET commented Aug 31, 2022

PR description:

PR validation:

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

cmsbuild commented Aug 31, 2022

cmsbuild commented Aug 31, 2022

srimanob commented Aug 31, 2022

srimanob Aug 31, 2022 • edited Loading

Choose a reason for hiding this comment

sunilUIET Aug 31, 2022

Choose a reason for hiding this comment

srimanob Aug 31, 2022

Choose a reason for hiding this comment

sunilUIET Aug 31, 2022

Choose a reason for hiding this comment

srimanob commented Aug 31, 2022

cmsbuild commented Aug 31, 2022

cmsbuild commented Aug 31, 2022

srimanob commented Aug 31, 2022

cmsbuild commented Aug 31, 2022

RelVals-INPUT

Comparison Summary

srimanob commented Sep 1, 2022

srimanob commented Sep 1, 2022

cmsbuild commented Sep 1, 2022

Comparison Summary

srimanob commented Sep 1, 2022

kskovpen commented Sep 1, 2022

cmsbuild commented Sep 1, 2022

perrotta commented Sep 1, 2022

srimanob Aug 31, 2022 •

edited

Loading