Excluding openj9 specific tests and zos specific tests for jdk11 and later releases #2423

psoujany · 2021-03-29T12:59:08Z

Excuding openj9 specific tests and zos specific tests for jdk11 and later releases.

Openj9 exclusions:
jdk_management
java/lang/management/ManagementFactory/ValidateOpenTypes.java
java/lang/management/MemoryMXBean/MemoryManagement.java
java/lang/management/ManagementFactory/ProxyTypeMapping.java
java/lang/management/MemoryMXBean/CollectionUsageThreshold.java
java/lang/management/MemoryMXBean/LowMemoryTest2.sh
java/lang/management/GarbageCollectorMXBean/GcInfoCompositeType.java
java/lang/management/CompositeData/MemoryUsageCompositeData.java
javax/management/remote/mandatory/connection/DefaultAgentFilterTest.java
sun/management/jmxremote/bootstrap/LocalManagementTest.java
sun/management/jmxremote/startstop/JMXStartStopTest.java
sun/management/jmxremote/startstop/JMXStatusPerfCountersTest.java
sun/management/jmxremote/startstop/JMXStatusTest.java

z/OS specific:
jdk_nio
java/nio/channels/Selector/OutOfBand.java
java/nio/channels/FileChannel/directio/ReadDirect.java
java/nio/channels/FileChannel/directio/PreadDirect.java
java/nio/channels/FileChannel/directio/PwriteDirect.java
java/nio/channels/FileChannel/TempDirectBuffersReclamation.java

Note :- Openj9 specific exclusions are applicable for jdk11 and later versions whereas z/OS specific exclusions are applicable only for jdk11.

…ater releases

llxia · 2021-04-06T15:07:18Z

For permanent excludes, please use the correct issue number. i.e., #1297

For temporary excludes, please open the issue with more details.

#2422 does not have enough information as to failure defails and why the test should be excluded (product defect, infra issue, or test not applicable, etc)

If there is an internal issue opened for this, please put it in the description (with a format like backlog/issues/494) , so we can trace it back if needed.

) Signed-off-by: Simon Rushton <[email protected]>

…2413) Signed-off-by: [email protected] <[email protected]>

This reverts commit 0292fc0.

Add instructions for running locally

Fix spelling

* Exclude failing extended.jck tests Signed-off-by: [email protected] <[email protected]> * Exclude failing extended.jck tests Signed-off-by: [email protected] <[email protected]>

Similar to what is done for ACTUAL_TEST_JOB_NAME, use and reset the ACTUAL_JCK_GIT_REPO every loop in order to hit the condition everytime. Otherwise JCK_GIT_REPO would be set on the first loop for the duration of the build. Signed-off-by: Adam Brousseau <[email protected]>

* Moved openjdk problem lists into excludes folder * Edited path to ProblemList files

Signed-off-by: lanxia <[email protected]>

* remove PushOrPRtestbuild.yml * Add JDK_NATIVE_OPTIONS to all test targets Signed-off-by: yanshan24 <[email protected]> * remove $(JDK_NATIVE_OPTIONS) and add $(JVM_NATIVE_OPTIONS) for hostpot test targets; modify jdk_build and jdk_jfc_demo test cases Signed-off-by: yanshan24 <[email protected]> * remove $(JVM_NATIVE_OPTIONS) from jdk_custom Signed-off-by: Yanshan Wan <[email protected]>

) On JDK8 with Hotspot, s390 has no JIT. This results in a number of tests running for over an hour, eventually causing an extended.openjdk test run on Jenkins to be aborted due to the usual 10hr timeout. While it seems likely we will not be running extended.openjdk on s390 (for JDK8 on Hotspot, anyway) for much longer, I'm excluding these tests for now so that the test bucket is viable, should we choose to run it again in the future. Signed-off-by: Adam Farley <[email protected]>

Signed-off-by: Sophia Guo <[email protected]>

* Create README.md * Create test.properties

* Delete Dockerfile * Create README.md * Create test.properties

) * Add --help to documentation

* Style parameters in testJobTemplate

psoujany · 2021-04-07T06:47:02Z

For permanent excludes, please use the correct issue number. i.e., #1297

For temporary excludes, please open the issue with more details.

#2422 does not have enough information as to failure defails and why the test should be excluded (product defect, infra issue, or test not applicable, etc)

If there is an internal issue opened for this, please put it in the description (with a format like backlog/issues/494) , so we can trace it back if needed.

Updated #2422 with individual open issues. Please review the changes. Thank you.

…njdk-tests into zosjtreg-exclusions

Mesbah-Alam · 2021-04-08T14:17:24Z

openjdk/excludes/ProblemList_openjdk11-openj9.txt

@@ -201,6 +213,12 @@ java/nio/channels/DatagramChannel/Promiscuous.java https://github.com/AdoptOpenJ
 java/nio/channels/SocketChannel/AdaptSocket.java https://github.com/eclipse/openj9/issues/4317 macosx-all
 java/nio/file/Files/CopyAndMove.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/795 macosx-all
 jdk/nio/zipfs/ZipFSTester.java https://github.com/eclipse/openj9/issues/4679 linux-x64,macosx-all
+java/nio/channels/Selector/OutOfBand.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/2422 z/OS-s390x


According to your comment in #2422, You are excluding java/nio/channels/Selector/OutOfBand.java temporarily due to openj9-openjdk-jdk11-zos/issues/575. So, The PR for the exclusion should have openj9-openjdk-jdk11-zos/issues/575 as the cause of this temporary exclusion, not #2422. I believe #2422 is just an issue you created for triage, it should not be used as a reason for an exclusion.

Hi @Mesbah-Alam - I think in a previous PR from @psoujany I had requested that we ideally reference open issues for exclusions (so that when we automate the checking of them, the automation script can access them). Though it is fine to reference the internal issue in the placeholder issue. (I don't like that we have duplicate issue, but I do not see a way around it, and I will hope that the temporary placeholder issues are not long-lived).

@ShelleyLambert Hi Shelley, oh.. I wasn't aware of that automation :) .. In that case I am fine with using the open issue in the exclude file! @psoujany , please Ignore my comment about using openj9-openjdk-jdk11-zos/issues/575!

@Mesbah-Alam - Its upcoming automation (related: #1853 and #2368), but thought to enforce the use of full and openly accessible URLs so that when we do finish the automation, we do not have to update as many playlists and problemlists.

@ShelleyLambert - makes sense Shelley!

smlambert · 2021-04-14T22:24:55Z

I do not know where this sits, or if its ready for merge (and not a way to verify on zos). Relying on @Mesbah-Alam and @llxia for review. As its exclusions, it will be exempt from the code freeze that will be in place until release next week completes.

pushkarnk · 2021-04-21T06:52:38Z

I guess this is ready for merge. Can we merge it pease?

mamatha-jv · 2021-04-21T10:57:58Z

@llxia
Can you please merge this?

llxia · 2021-04-21T14:20:33Z

Not sure if z/OS-s390x works. Did we test it in Grinder?

psoujany · 2021-04-22T08:20:33Z

Not sure if z/OS-s390x works. Did we test it in Grinder?

Yes z/OS-s390x works, here's the Grinder hyc-runtimes-team-svt-jenkins.swg-devops.com/Test_grinder/job/Grinder/1207

llxia · 2021-04-22T13:16:03Z

Thanks @psoujany

mamatha-jv · 2021-04-26T05:25:01Z

@Mesbah-Alam
Can you please review this issue?

Mesbah-Alam

LGTM

mamatha-jv · 2021-04-28T06:17:00Z

@Mesbah-Alam Thank you.
@llxia Can you please merge this now?

llxia · 2021-04-28T14:17:16Z

FYI @pshipton @JasonFengJ9

mamatha-jv · 2021-04-29T06:01:14Z

@llxia Thank you very much!

Excuding openj9 specific tests and zos specific tests for jdk11 and l…

52145eb

…ater releases

karianna added the bug label Mar 31, 2021

karianna changed the title ~~Excuding openj9 specific tests and zos specific tests for jdk11 and later releases~~ Excluding openj9 specific tests and zos specific tests for jdk11 and later releases Mar 31, 2021

karianna added this to the March 2021 milestone Mar 31, 2021

smlambert requested review from llxia and Mesbah-Alam April 1, 2021 01:10

psoujany mentioned this pull request Apr 5, 2021

JTReg : Excluding tests which are failing with JDK11 z/OS #2422

Closed

psoujany and others added 20 commits April 7, 2021 11:38

Merge remote-tracking branch 'upstream/master' into zosjtreg-exclusions

f5b8c8b

Changing permanent excludes PR to 1297

2510774

Reinstate PatMod_PlatMod and PatModImg_PlatMod systemtests on AIX (#2411

f1a894a

) Signed-off-by: Simon Rushton <[email protected]>

Add --add-opens for java.lang + java.io in system_custom by default (#…

69aa030

…2413) Signed-off-by: [email protected] <[email protected]>

Update README.md

a267854

Separate Jenkins Parameters into Categories (#2375)

fd6a136

Add documentation for the Run AQA workflow (#2424)

c7456e5

Revert "Separate Jenkins Parameters into Categories (#2375)" (#2427)

efa407d

This reverts commit 0292fc0.

Update README.md

1a3816a

Add instructions for running locally

Update README.md

945b51f

Fix spelling

Temporarily exclude certain jck extended tests from automation (#2418)

de3bc09

* Exclude failing extended.jck tests Signed-off-by: [email protected] <[email protected]> * Exclude failing extended.jck tests Signed-off-by: [email protected] <[email protected]>

Remove RUNTIME_NAME parameter from JenkinsfileBase file (#2437)

272c12f

Move problem lists (#2428)

578132e

* Moved openjdk problem lists into excludes folder * Edited path to ProblemList files

Only generate child jobs if they do not exist (#2426)

92d3f8a

Signed-off-by: lanxia <[email protected]>

Create Prerequisites.md

a4cb8ea

Update README.md

a15fcfe

If DOCKERIMAGE_TAG is not set set nightly as default (#2462)

333476b

Signed-off-by: Sophia Guo <[email protected]>

vanichitkara and others added 5 commits April 7, 2021 12:13

Completed prep work for netty tests (#2452)

6451c90

* Create README.md * Create test.properties

Completed prep work for elasticsearch tests (#2460)

6716862

* Delete Dockerfile * Create README.md * Create test.properties

Add help command to Run AQA (Comment-Triggered PR Build) Workflow (#2457

65da458

) * Add --help to documentation

Separate jenkins params (#2464)

705371a

* Style parameters in testJobTemplate

Changing permanent excludes PR to 1297

b467f34

Merge branch 'zosjtreg-exclusions' of https://github.com/psoujany/ope…

55fa118

…njdk-tests into zosjtreg-exclusions

Mesbah-Alam reviewed Apr 8, 2021

View reviewed changes

karianna modified the milestones: March 2021, April 2021 Apr 19, 2021

Merge remote-tracking branch 'upstream/master' into zosjtreg-exclusions

7db6184

llxia approved these changes Apr 22, 2021

View reviewed changes

Mesbah-Alam approved these changes Apr 27, 2021

View reviewed changes

llxia merged commit 1f1db41 into adoptium:master Apr 28, 2021

psoujany deleted the zosjtreg-exclusions branch May 25, 2021 14:09

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Excluding openj9 specific tests and zos specific tests for jdk11 and later releases #2423

Excluding openj9 specific tests and zos specific tests for jdk11 and later releases #2423

psoujany commented Mar 29, 2021

llxia commented Apr 6, 2021 •

edited

Loading

psoujany commented Apr 7, 2021

Mesbah-Alam Apr 8, 2021

smlambert Apr 8, 2021

Mesbah-Alam Apr 8, 2021 •

edited

Loading

smlambert Apr 8, 2021 •

edited

Loading

Mesbah-Alam Apr 9, 2021

smlambert commented Apr 14, 2021

pushkarnk commented Apr 21, 2021

mamatha-jv commented Apr 21, 2021

llxia commented Apr 21, 2021

psoujany commented Apr 22, 2021

llxia commented Apr 22, 2021

mamatha-jv commented Apr 26, 2021

Mesbah-Alam left a comment

mamatha-jv commented Apr 28, 2021

llxia commented Apr 28, 2021

mamatha-jv commented Apr 29, 2021

Excluding openj9 specific tests and zos specific tests for jdk11 and later releases #2423

Excluding openj9 specific tests and zos specific tests for jdk11 and later releases #2423

Conversation

psoujany commented Mar 29, 2021

llxia commented Apr 6, 2021 • edited Loading

psoujany commented Apr 7, 2021

Mesbah-Alam Apr 8, 2021

Choose a reason for hiding this comment

smlambert Apr 8, 2021

Choose a reason for hiding this comment

Mesbah-Alam Apr 8, 2021 • edited Loading

Choose a reason for hiding this comment

smlambert Apr 8, 2021 • edited Loading

Choose a reason for hiding this comment

Mesbah-Alam Apr 9, 2021

Choose a reason for hiding this comment

smlambert commented Apr 14, 2021

pushkarnk commented Apr 21, 2021

mamatha-jv commented Apr 21, 2021

llxia commented Apr 21, 2021

psoujany commented Apr 22, 2021

llxia commented Apr 22, 2021

mamatha-jv commented Apr 26, 2021

Mesbah-Alam left a comment

Choose a reason for hiding this comment

mamatha-jv commented Apr 28, 2021

llxia commented Apr 28, 2021

mamatha-jv commented Apr 29, 2021

llxia commented Apr 6, 2021 •

edited

Loading

Mesbah-Alam Apr 8, 2021 •

edited

Loading

smlambert Apr 8, 2021 •

edited

Loading