[GCC12] Update latest commit; sync g13 changes; add gcc-prereq spec

[smuzaffar]

• Build latest GCC 12 commit ( which contains Backported changes https://gcc.gnu.org/bugzilla/show_bug.cgi?id=111936 fix )
• enable stdcxx backtrace
• backport changes from GCC 13 branch to make gcc12 and gcc13 branches as close as possible
• Split gcc spec in to gcc-prerequisites and gcc

[smuzaffar]

test parameters:

• full_cmssw = true

[cmsbuild]

A new Pull Request was created by @smuzaffar (Malik Shahzad Muzaffar) for branch IB/CMSSW_14_0_X/master.

@smuzaffar, @aandvalenzuela, @cmsbuild, @iarspider can you please review it and eventually sign? Thanks.
@rappoccio, @sextonkennedy, @antoniovilela you are the release manager for this.
cms-bot commands are listed here

[smuzaffar]

please test

[cmsbuild]

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-383647/35887/summary.html
COMMIT: 589731c
CMSSW: CMSSW_14_0_X_2023-11-16-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8822/35887/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation error when building:

cwd: /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/el8_amd64_gcc12/external/py3-cryptography/41.0.3-cacc04925b62d7ea7c27f7d0673ca462/cmsdist-tmp/pip-req-build-tkpmlaul
Building wheel for cryptography (pyproject.toml): finished with status 'error'
ERROR: Failed building wheel for cryptography
Failed to build cryptography
ERROR: Could not build wheels for cryptography, which is required to install pyproject.toml-based projects
error: Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.iY0nVz (%build)


RPM build errors:
line 37: It's not recommended to have unversioned Obsoletes: Obsoletes: external+py3-cryptography+41.0.3-cacc04925b62d7ea7c27f7d0673ca462
Macro expanded in comment on line 375: %{pkginstroot}/bin/*


[smuzaffar]

please test

[cmsbuild]

Pull request #8822 was updated.

[cmsbuild]

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-383647/35909/summary.html
COMMIT: a80fb9d
CMSSW: CMSSW_14_0_X_2023-11-16-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8822/35909/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation warning when building: See details on the summary page.

[smuzaffar]

please test

[cmsbuild]

-1

Failed Tests: UnitTests RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-383647/35911/summary.html
COMMIT: a80fb9d
CMSSW: CMSSW_14_0_X_2023-11-16-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8822/35911/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @Prasant1993 Add Correct EGM Run3 electron NonIso MVA ID for EB  cmssw#43275
• @Dr15Jones Change Sonic to use ExternalFailure exception cmssw#43274

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-383647/35911/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-383647/35911/git-merge-result

Unit Tests

I found 2 errors in the following unit tests:

---> test runtestRecoEgammaElectronIdentification had ERRORS
---> test testTauEmbeddingProducers had ERRORS

RelVals

• 136.8311

----- Begin Fatal Exception 17-Nov-2023 16:27:20 CET-----------------------
An exception of category 'MVA config failure: ' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=ElectronMVAValueMapProducer label='electronMVAValueMapProducer'
Exception Message:
Concerning ElectronMVAEstimatorRun2RunIIIWinter22NoIsoV1
Variable ele_hcalPFClusterIso not found in variable definition file!
----- End Fatal Exception -------------------------------------------------

• 136.88811

----- Begin Fatal Exception 17-Nov-2023 16:27:20 CET-----------------------
An exception of category 'MVA config failure: ' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=ElectronMVAValueMapProducer label='electronMVAValueMapProducer'
Exception Message:
Concerning ElectronMVAEstimatorRun2RunIIIWinter22NoIsoV1
Variable ele_hcalPFClusterIso not found in variable definition file!
----- End Fatal Exception -------------------------------------------------

• 136.7611

----- Begin Fatal Exception 17-Nov-2023 16:27:20 CET-----------------------
An exception of category 'MVA config failure: ' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=ElectronMVAValueMapProducer label='electronMVAValueMapProducer'
Exception Message:
Concerning ElectronMVAEstimatorRun2RunIIIWinter22NoIsoV1
Variable ele_hcalPFClusterIso not found in variable definition file!
----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

• 4.53
• 135.4
• 136.731
• 158.01
• 136.793
• 136.874
• 139.001
• 2018.1
• 9.0
• 1306.0
• 25.0
• 1330.0
• 312.0
• 141.044
• 13234.0
• 10042.0
• 14034.0
• 14234.0
• 10024.0
• 11634.0
• 10824.0
• 25202.0
• 2500.4
• 11634.911
• 12434.0
• 11634.914
• 10224.0
• 12434.7
• 24900.0
• 24896.0
• 12634.0
• 24834.0
• 23234.0
• 250202.181
• 25034.999
• 24834.911

[smuzaffar]

please test

[cmsbuild]

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-383647/35943/summary.html
COMMIT: a80fb9d
CMSSW: CMSSW_14_0_X_2023-11-19-0000/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8822/35943/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 1 errors in the following unit tests:

---> test RecoPPSLocalNewT2 had ERRORS

Comparison Summary

Summary:

• You potentially added 74 lines to the logs
• Reco comparison results: 582 differences found in the comparisons
• DQMHistoTests: Total files compared: 50
• DQMHistoTests: Total histograms compared: 3363868
• DQMHistoTests: Total failures: 2355
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3361491
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 49 files compared)
• Checked 214 log files, 167 edm output root files, 50 DQM output files
• TriggerResults: no differences found