Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

jdk8 nightly build runs different sanity.system tests to a weekly build #2152

Closed
lumpfish opened this issue Jan 11, 2021 · 5 comments
Closed

jdk8 nightly build runs different sanity.system tests to a weekly build #2152

lumpfish opened this issue Jan 11, 2021 · 5 comments
Labels
bug duplicate
Milestone
January 2021

Comments

@lumpfish
Copy link
Contributor

In a jdk nightly build (started via https://ci.adoptopenjdk.net/job/build-scripts/job/openjdk8-pipeline/) a sanity.system test runs the following tests: (e.g. https://ci.adoptopenjdk.net/job/Test_openjdk8_hs_sanity.system_x86-32_windows/115/console):

19:25:07  TEST TARGETS SUMMARY
19:25:07  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
19:25:07  PASSED test targets:
19:25:07  	MachineInfo_0
19:25:07  	MachineInfo_0
19:25:07  	TestJlmLocal_0
19:25:07  	TestJlmRemoteClassNoAuth_0
19:25:07  	TestJlmRemoteMemoryNoAuth_0
19:25:07  	TestJlmRemoteThreadNoAuth_0
19:25:07  	MachineInfo_0
19:25:07  	LambdaLoadTest_Hotspot_0
19:25:07  	MachineInfo_0
19:25:07  	MathLoadTest_autosimd_0
19:25:07  	MathLoadTest_bigdecimal_0
19:25:07  	MachineInfo_0
19:25:07  	MauveSingleThrdLoad_HS_0
19:25:07  	MauveSingleInvocLoad_HS_0
19:25:07  	MauveMultiThrdLoad_0
19:25:07  	MachineInfo_0
19:25:07  	MachineInfo_0
19:25:07  	ClassLoadingTest_0
19:25:07  	NioLoadTest_0
19:25:07  	MachineInfo_0
19:25:07  
19:25:07  TOTAL: 24   EXECUTED: 20   PASSED: 20   FAILED: 0   DISABLED: 0   SKIPPED: 4

whereas when the same test target is run via a build started from the weekly build pipeline https://ci.adoptopenjdk.net/job/build-scripts/job/weekly-openjdk8-pipeline/ the following tests are run:

12:49:09  TEST TARGETS SUMMARY
12:49:09  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
12:49:09  PASSED test targets:
12:49:09  	MachineInfo_0
12:49:09  	MachineInfo_0
12:49:09  	MachineInfo_0
12:49:09  	MachineInfo_0
12:49:09  	MachineInfo_0
12:49:09  	MachineInfo_0
12:49:09  	MachineInfo_0
12:49:09  	MachineInfo_0
12:49:09  
12:49:09  FAILED test targets:
12:49:09  	TestJlmLocal_1
12:49:09  	TestJlmRemoteClassNoAuth_1
12:49:09  	TestJlmRemoteMemoryNoAuth_1
12:49:09  	TestJlmRemoteThreadNoAuth_1
12:49:09  	LambdaLoadTest_Hotspot_1
12:49:09  	MathLoadTest_autosimd_1
12:49:09  	MathLoadTest_bigdecimal_1
12:49:09  	MauveSingleThrdLoad_HS_1
12:49:09  	MauveSingleInvocLoad_HS_1
12:49:09  	MauveMultiThrdLoad_1
12:49:09  	ClassLoadingTest_1
12:49:09  	NioLoadTest_1
12:49:09  
12:49:09  TOTAL: 40   EXECUTED: 20   PASSED: 8   FAILED: 12   DISABLED: 0   SKIPPED: 20
@andrew-m-leonard
Copy link
Contributor

It changed 3 days ago: e88557b

@lumpfish
Copy link
Contributor Author

lumpfish commented Jan 11, 2021 •
edited
Loading

Thanks for pointing this out @andrew-m-leonard. Unfortunately the options now being used are not recognised by jdk8 win32 hotspot so all the tests fail:

12:49:02  STF 06:49:03.569 - ====================   E X E C U T E -   ====================
12:49:02  STF 06:49:03.569 - Running execute: perl E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/openjdk-tests/\TKG\test_output_16101964807505\ClassLoadingTest_1/20210109-064901-ClassloadingLoadTest/execute.pl
12:49:02  STF 06:49:03.737 - 
12:49:02  STF 06:49:03.737 - Java version
12:49:02  STF 06:49:03.738 - Running: E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/openjdkbinary/j2sdk-image/bin/java -version
12:49:02  openjdk version "1.8.0_282"
12:49:02  OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_282-b07)
12:49:02  OpenJDK Client VM (AdoptOpenJDK)(build 25.282-b07, mixed mode)
12:49:02  STF 06:49:03.905 - 
12:49:02  STF 06:49:03.905 - +------ Step 1 - Run classloading tests
12:49:02  STF 06:49:03.905 - | Run foreground process
12:49:02  STF 06:49:03.905 - |   Program:     E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/openjdkbinary/j2sdk-image/bin/java
12:49:02  STF 06:49:03.905 - |   Mnemonic:    CLT
12:49:02  STF 06:49:03.905 - |   Echo:        ECHO_ON
12:49:02  STF 06:49:03.905 - |   Expectation: CLEAN_RUN within 2h
12:49:02  STF 06:49:03.905 - |
12:49:02  STF 06:49:03.905 - Running command: E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/openjdkbinary/j2sdk-image/bin/java -Djava.classloading.dir=E:\workspace\Test_openjdk8_hs_sanity.system_x86-32_windows\jvmtest\system\openjdk-systemtest -Djava.version.number=8 -XX:-UseCompressedOops -classpath E:\workspace\Test_openjdk8_hs_sanity.system_x86-32_windows\jvmtest\system\stf\stf.load\bin;E:\workspace\Test_openjdk8_hs_sanity.system_x86-32_windows\jvmtest\system\stf\stf.core\bin;E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/jvmtest/system/systemtest_prereqs/log4j-2.13.3/log4j-api-2.13.3.jar;E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/jvmtest/system/systemtest_prereqs/log4j-2.13.3/log4j-core-2.13.3.jar;E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/jvmtest/system/systemtest_prereqs/junit-4.12/junit-4.12.jar;E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/jvmtest/system/systemtest_prereqs/junit-4.12/hamcrest-core-1.3.jar;E:\workspace\Test_openjdk8_hs_sanity.system_x86-32_windows\jvmtest\system\openjdk-systemtest\openjdk.test.classloading\bin net.adoptopenjdk.loadTest.LoadTest -resultsDir E:\workspace\Test_openjdk8_hs_sanity.system_x86-32_windows\openjdk-tests\TKG\test_output_16101964807505\ClassLoadingTest_1\20210109-064901-ClassloadingLoadTest\results -resultsPrefix 1.CLT. -abortIfOutOfMemory false -reportFailureLimit 1 -abortAtFailureLimit 10 -maxTotalLogFileSpace 200M -maxSingleLogSize 1/25 -suite.classloading.threadCount 10 -suite.classloading.inventoryFile E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/openjdk-tests/TKG/test_output_16101964807505/ClassLoadingTest_1/20210109-064901-ClassloadingLoadTest/results/1.CLT.inventory/openjdk.test.load/config/inventories/classloading/classloading.xml -suite.classloading.inventoryExcludeFile none -suite.classloading.totalNumberTests 9000 -suite.classloading.selection random -suite.classloading.seed -1 -suite.classloading.repeatCount 1 -suite.classloading.thinkingTime 0ms..0ms
12:49:02  STF 06:49:03.906 - Redirecting stderr to E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/openjdk-tests/TKG/test_output_16101964807505/ClassLoadingTest_1/20210109-064901-ClassloadingLoadTest/results/1.CLT.stderr
12:49:02  STF 06:49:03.906 - Redirecting stdout to E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/openjdk-tests/TKG/test_output_16101964807505/ClassLoadingTest_1/20210109-064901-ClassloadingLoadTest/results/1.CLT.stdout
12:49:02  STF 06:49:03.942 - Monitoring processes: CLT
12:49:02  CLT stderr Error: Could not create the Java Virtual Machine.
12:49:02  CLT stderr Error: A fatal exception has occurred. Program will exit.
12:49:02  CLT stderr Unrecognized VM option 'UseCompressedOops'
12:49:02  CLT stderr Did you mean '(+/-)CheckCompressedOops'?
12:49:02  STF 06:49:03.966 - **FAILED** Process CLT ended with exit code (1) and not the expected exit code/s (0)
12:49:02  STF 06:49:03.966 - Monitoring Report Summary:
12:49:02  STF 06:49:03.966 -   o Process CLT ended with exit code (1) and not the expected exit code/s (0)
12:49:02  STF 06:49:03.967 - Killing processes: CLT
12:49:02  STF 06:49:03.967 -   o Process CLT pid 21364 is not running
12:49:02  **FAILED** at step 1 (Run classloading tests). Expected return value=0 Actual=1 at E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/openjdk-tests/\TKG\test_output_16101964807505\ClassLoadingTest_1/20210109-064901-ClassloadingLoadTest/execute.pl line 96.
12:49:02  STF 06:49:03.986 - **FAILED** execute script failed. Expected return value=0 Actual=1
12:49:02  STF 06:49:03.986 - 
12:49:02  STF 06:49:03.986 - ====================   T E A R D O W N   ====================
12:49:02  STF 06:49:03.986 - Running teardown: perl E:/workspace/Test_openjdk8_hs_sanity.system_x86-32_windows/openjdk-tests/\TKG\test_output_16101964807505\ClassLoadingTest_1/20210109-064901-ClassloadingLoadTest/tearDown.pl
12:49:02  STF 06:49:04.154 - TEARDOWN stage completed
12:49:02  STF 06:49:04.167 - 
12:49:02  STF 06:49:04.167 - =====================   R E S U L T S   =====================
12:49:02  STF 06:49:04.167 - Stage results:
12:49:02  STF 06:49:04.167 -   setUp:     pass
12:49:02  STF 06:49:04.167 -   execute:  *fail*
12:49:02  STF 06:49:04.167 -   teardown:  pass
12:49:02  STF 06:49:04.167 - 
12:49:02  STF 06:49:04.167 - Overall result: **FAILED**
12:49:02  
12:49:02  ClassLoadingTest_1_FAILED

@llxia ??

@smlambert
Copy link
Contributor

smlambert commented Jan 11, 2021 •
edited
Loading

#2137 (comment) - think it requires some additional change in TKG csv files for win32 platform

@smlambert
Copy link
Contributor

(and noting that we run more system tests if we thinks its an openj9 versus hotspot, as it would pull in and run openj9-systemtest repo also)

@llxia
Copy link
Contributor

llxia commented Jan 11, 2021 •
edited
Loading

dup of #2137
#2137 (comment)

@karianna karianna added this to the January 2021 milestone Jan 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug duplicate
Projects
None yet
Milestone
January 2021
Development

No branches or pull requests
5 participants
@karianna @smlambert @llxia @lumpfish @andrew-m-leonard