Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Archive openjdk regression tests output including diagnostic files #1073

Merged
merged 1 commit into from
Apr 22, 2019

Conversation

llxia
Copy link
Contributor

@llxia llxia commented Apr 12, 2019

  • Change workDir from $(TEST_RESROOT) to TKG $(REPORTDIR) so it will be
    archived by default
  • Do not need to archive *.jtr separately in Jenkins file as *.jtr are under
    $(REPORTDIR) (i.e., test_output_*) now and they will be archived by default

Fixes: eclipse-openj9/openj9#5454

Signed-off-by: lanxia [email protected]

- Change workDir from $(TEST_RESROOT) to TKG $(REPORTDIR) so it will be
archived by default
- Do not need to archive *.jtr separately as *.jtr are under
$(REPORTDIR) and they will be archived by default

Signed-off-by: lanxia <[email protected]>
@llxia
Copy link
Contributor Author

llxia commented Apr 12, 2019

https://ci.eclipse.org/openj9/view/Test_grinder/job/Test-Grinder_Sandbox/28/

Output:

05:07:05.270  Unhandled exception
05:07:05.270  Type=Segmentation error vmState=0x00000000
05:07:05.270  J9Generic_Signal_Number=00000004 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
05:07:05.270  Handler1=000000000E0A20B0 Handler2=000000000E2A7340 InaccessibleAddress=0000000000000000
05:07:05.270  RDI=0000000010292B00 RSI=000000000FFBB220 RAX=0000000010292B00 RBX=00007000008EDAB8
05:07:05.270  RCX=0000000000000000 RDX=000000000FFBB220 R8=00000000000E0000 R9=00000000100D3300
05:07:05.270  R10=00007000008EDAE0 R11=0000000035AC7B0B R12=00007000008EDAC8 R13=00007000008EDAC0
05:07:05.270  R14=00007000008EDAB8 R15=00007000008EDAC0
05:07:05.270  RIP=0000000000000000 GS=0000 FS=0000 RSP=00007000008ED7B8
05:07:05.270  RFlags=0000000000010246 CS=002B RBP=00007000008EDAA0 ERR=0000000000000014
05:07:05.270  TRAPNO=000000140000000E CPU=0000000000140000 FAULTVADDR=0000000000000000
05:07:05.270  XMM0 0000000035ac7b0b (f: 900496128.000000, d: 4.449042e-315)
05:07:05.270  XMM1 0000000010292698 (f: 271132320.000000, d: 1.339572e-315)
05:07:05.270  XMM2 c3e0000000000000 (f: 0.000000, d: -9.223372e+18)
05:07:05.270  XMM3 0000000000000016 (f: 22.000000, d: 1.086944e-322)
05:07:05.270  XMM4 000000000000002f (f: 47.000000, d: 2.322109e-322)
05:07:05.270  XMM5 3fd2e8e300000000 (f: 0.000000, d: 2.954643e-01)
05:07:05.270  XMM6 000fffffffffffff (f: 4294967296.000000, d: 2.225074e-308)
05:07:05.270  XMM7 3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
05:07:05.270  XMM8 0000000000000000 (f: 0.000000, d: 0.000000e+00)
05:07:05.270  XMM9 0000000000000000 (f: 0.000000, d: 0.000000e+00)
05:07:05.270  XMM10 0000000000000000 (f: 0.000000, d: 0.000000e+00)
05:07:05.270  XMM11 0000000000000000 (f: 0.000000, d: 0.000000e+00)
05:07:05.270  XMM12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
05:07:05.270  XMM13 0000000000000000 (f: 0.000000, d: 0.000000e+00)
05:07:05.270  XMM14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
05:07:05.270  XMM15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
05:07:05.270  Target=2_90_20190410_201 (Mac OS X 10.11.6)
05:07:05.270  CPU=amd64 (4 logical CPUs) (0x200000000 RAM)
05:07:05.270  ----------- Stack Backtrace -----------
05:07:05.270  ---------------------------------------
05:07:05.270  JVMDUMP039I Processing dump event "gpf", detail "" at 2019/04/12 04:11:36 - please wait.
05:07:05.270  JVMDUMP032I JVM requested System dump using '/Users/jenkins/workspace/Test-Grinder_Sandbox/openjdk-tests/TestConfig/test_output_15550559055705/jdk_util_0/work/java/util/stream/test/org/openjdk/tests/java/util/stream/RangeTest/core.20190412.041136.24905.0001.dmp' in response to an event
05:07:05.270  JVMDUMP010I System dump written to /Users/jenkins/workspace/Test-Grinder_Sandbox/openjdk-tests/TestConfig/test_output_15550559055705/jdk_util_0/work/java/util/stream/test/org/openjdk/tests/java/util/stream/RangeTest/core.20190412.041136.24905.0001.dmp
05:07:05.270  JVMDUMP032I JVM requested Java dump using '/Users/jenkins/workspace/Test-Grinder_Sandbox/openjdk-tests/TestConfig/test_output_15550559055705/jdk_util_0/work/java/util/stream/test/org/openjdk/tests/java/util/stream/RangeTest/javacore.20190412.041136.24905.0002.txt' in response to an event
05:07:05.270  JVMDUMP010I Java dump written to /Users/jenkins/workspace/Test-Grinder_Sandbox/openjdk-tests/TestConfig/test_output_15550559055705/jdk_util_0/work/java/util/stream/test/org/openjdk/tests/java/util/stream/RangeTest/javacore.20190412.041136.24905.0002.txt
05:07:05.270  JVMDUMP032I JVM requested Snap dump using '/Users/jenkins/workspace/Test-Grinder_Sandbox/openjdk-tests/TestConfig/test_output_15550559055705/jdk_util_0/work/java/util/stream/test/org/openjdk/tests/java/util/stream/RangeTest/Snap.20190412.041136.24905.0003.trc' in response to an event
05:07:05.270  JVMDUMP010I Snap dump written to /Users/jenkins/workspace/Test-Grinder_Sandbox/openjdk-tests/TestConfig/test_output_15550559055705/jdk_util_0/work/java/util/stream/test/org/openjdk/tests/java/util/stream/RangeTest/Snap.20190412.041136.24905.0003.trc
05:07:05.270  JVMDUMP007I JVM Requesting JIT dump using '/Users/jenkins/workspace/Test-Grinder_Sandbox/openjdk-tests/TestConfig/test_output_15550559055705/jdk_util_0/work/java/util/stream/test/org/openjdk/tests/java/util/stream/RangeTest/jitdump.20190412.041136.24905.0004.dmp'
05:07:05.270  JVMDUMP010I JIT dump written to /Users/jenkins/workspace/Test-Grinder_Sandbox/openjdk-tests/TestConfig/test_output_15550559055705/jdk_util_0/work/java/util/stream/test/org/openjdk/tests/java/util/stream/RangeTest/jitdump.20190412.041136.24905.0004.dmp

dmp can be found in the archive: https://140-211-168-230-openstack.osuosl.org/artifactory/ci-eclipse-openj9/Test/Test-Grinder_Sandbox/28/

Lans-MacBook-Pro:TestConfig lanxia$ find . -name *.dmp
./test_output_15550559055705/jdk_util_0/work/java/util/stream/test/org/openjdk/tests/java/util/stream/RangeTest/core.20190412.041136.24905.0001.dmp
./test_output_15550559055705/jdk_util_0/work/java/util/stream/test/org/openjdk/tests/java/util/stream/RangeTest/jitdump.20190412.041136.24905.0004.dmp

@llxia llxia requested review from smlambert and sophia-guo April 12, 2019 16:23
@llxia
Copy link
Contributor Author

llxia commented Apr 12, 2019

  • I could also change reportDir -r $(Q)$(TEST_RESROOT)$(D)report$(Q) to TKG $(REPORTDIR)/report (contains html files), so it will be archived by default. I didn't change it in this PR since it looks like no one uses it. People that run openjdk regression locally will be able to see the reportDir.
  • I did not add specific files (i.e., *.dmp,javacore.*,*.trc,*.phd) in -retain option as I noticed that the passed tests also generated core files. Saving these core files will make archive size too big.
00:01:41.868  XML output with verification to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work
00:05:19.652  [2019-04-11 20:10:59,233] Agent[3]: stderr: JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2019/04/11 20:10:59 - please wait.
00:05:19.652  [2019-04-11 20:10:59,242] Agent[3]: stderr: JVMDUMP032I JVM requested System dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/core.20190411.201059.22547.0001.dmp' in response to an event
00:05:19.652  [2019-04-11 20:11:00,918] Agent[3]: stderr: JVMDUMP010I System dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/core.20190411.201059.22547.0001.dmp
00:05:19.652  [2019-04-11 20:11:00,919] Agent[3]: stderr: JVMDUMP032I JVM requested Heap dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/heapdump.20190411.201059.22547.0002.phd' in response to an event
00:05:19.652  [2019-04-11 20:11:01,095] Agent[3]: stderr: JVMDUMP010I Heap dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/heapdump.20190411.201059.22547.0002.phd
00:05:19.652  [2019-04-11 20:11:01,100] Agent[3]: stderr: JVMDUMP032I JVM requested Java dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/javacore.20190411.201059.22547.0003.txt' in response to an event
00:05:19.652  [2019-04-11 20:11:01,123] Agent[3]: stderr: JVMDUMP010I Java dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/javacore.20190411.201059.22547.0003.txt
00:05:19.652  [2019-04-11 20:11:01,133] Agent[3]: stderr: JVMDUMP032I JVM requested Snap dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/Snap.20190411.201059.22547.0004.trc' in response to an event
00:05:19.652  [2019-04-11 20:11:01,134] Agent[3]: stderr: JVMDUMP010I Snap dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/Snap.20190411.201059.22547.0004.trc
00:05:19.652  [2019-04-11 20:11:01,136] Agent[3]: stderr: JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".
00:05:19.652  [2019-04-11 20:11:01,824] Agent[3]: stderr: JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2019/04/11 20:11:01 - please wait.
00:05:19.652  [2019-04-11 20:11:01,826] Agent[3]: stderr: JVMDUMP032I JVM requested Heap dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/heapdump.20190411.201101.22547.0005.phd' in response to an event
00:05:19.652  [2019-04-11 20:11:01,960] Agent[3]: stderr: JVMDUMP010I Heap dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/heapdump.20190411.201101.22547.0005.phd
00:05:19.652  [2019-04-11 20:11:01,960] Agent[3]: stderr: JVMDUMP032I JVM requested Java dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/javacore.20190411.201101.22547.0006.txt' in response to an event
00:05:19.652  [2019-04-11 20:11:01,974] Agent[3]: stderr: JVMDUMP010I Java dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/javacore.20190411.201101.22547.0006.txt
00:05:19.652  [2019-04-11 20:11:01,974] Agent[3]: stderr: JVMDUMP032I JVM requested Snap dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/Snap.20190411.201101.22547.0007.trc' in response to an event
00:05:19.652  [2019-04-11 20:11:01,975] Agent[3]: stderr: JVMDUMP010I Snap dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/Snap.20190411.201101.22547.0007.trc
00:05:19.652  [2019-04-11 20:11:01,975] Agent[3]: stderr: JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".
00:05:19.652  [2019-04-11 20:11:02,292] Agent[3]: stderr: JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2019/04/11 20:11:02 - please wait.
00:05:19.652  [2019-04-11 20:11:02,294] Agent[3]: stderr: JVMDUMP032I JVM requested Heap dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/heapdump.20190411.201102.22547.0008.phd' in response to an event
00:05:19.652  [2019-04-11 20:11:02,407] Agent[3]: stderr: JVMDUMP010I Heap dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/heapdump.20190411.201102.22547.0008.phd
00:05:19.652  [2019-04-11 20:11:02,408] Agent[3]: stderr: JVMDUMP032I JVM requested Java dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/javacore.20190411.201102.22547.0009.txt' in response to an event
00:05:19.652  [2019-04-11 20:11:02,425] Agent[3]: stderr: JVMDUMP010I Java dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/javacore.20190411.201102.22547.0009.txt
00:05:19.652  [2019-04-11 20:11:02,426] Agent[3]: stderr: JVMDUMP032I JVM requested Snap dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/Snap.20190411.201102.22547.0010.trc' in response to an event
00:05:19.652  [2019-04-11 20:11:02,428] Agent[3]: stderr: JVMDUMP010I Snap dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/Snap.20190411.201102.22547.0010.trc
00:05:19.652  [2019-04-11 20:11:02,428] Agent[3]: stderr: JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".
00:05:19.652  [2019-04-11 20:11:02,786] Agent[3]: stderr: JVMDUMP039I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" at 2019/04/11 20:11:02 - please wait.
00:05:19.652  [2019-04-11 20:11:02,788] Agent[3]: stderr: JVMDUMP032I JVM requested Heap dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/heapdump.20190411.201102.22547.0011.phd' in response to an event
00:05:19.652  [2019-04-11 20:11:02,949] Agent[3]: stderr: JVMDUMP010I Heap dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/heapdump.20190411.201102.22547.0011.phd
00:05:19.652  [2019-04-11 20:11:02,950] Agent[3]: stderr: JVMDUMP032I JVM requested Java dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/javacore.20190411.201102.22547.0012.txt' in response to an event
00:05:19.652  [2019-04-11 20:11:02,972] Agent[3]: stderr: JVMDUMP010I Java dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/javacore.20190411.201102.22547.0012.txt
00:05:19.652  [2019-04-11 20:11:02,972] Agent[3]: stderr: JVMDUMP032I JVM requested Snap dump using '/home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/Snap.20190411.201102.22547.0013.trc' in response to an event
00:05:19.652  [2019-04-11 20:11:02,973] Agent[3]: stderr: JVMDUMP010I Snap dump written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work/scratch/1/Snap.20190411.201102.22547.0013.trc
00:05:19.652  [2019-04-11 20:11:02,973] Agent[3]: stderr: JVMDUMP013I Processed dump event "systhrow", detail "java/lang/OutOfMemoryError".
00:08:57.478  Test results: passed: 599
00:08:57.478  Report written to /home/jenkins/workspace/Grinder_Sandbox/jvmtest/openjdk_regression/report/html/report.html
00:08:57.478  Results written to /home/jenkins/workspace/Grinder_Sandbox/openjdk-tests/TestConfig/test_output_1555038444346/jdk_util_0/work
00:08:57.478  
00:08:57.478  jdk_util_0_PASSED

https://ci.adoptopenjdk.net/view/work%20in%20progress/job/Grinder_Sandbox/243/

@llxia
Copy link
Contributor Author

llxia commented Apr 12, 2019

Would like to deliver it after the release. Mark this PR WIP for now.

@llxia llxia changed the title Archive openjdk regression tests output including diagnostic files WIP: Archive openjdk regression tests output including diagnostic files Apr 12, 2019
@sophia-guo
Copy link
Contributor

workDir is also the location for all executed tests, i.e. .class files. Probably filter those to reduce the archive size?

@llxia
Copy link
Contributor Author

llxia commented Apr 12, 2019

I checked the tar size and .class files does not seem to affect much, so I will keep them for now.

@smlambert
Copy link
Contributor

At one point very early on, we archived html files, but @akolarkunnu advised that the jtr files contained more information and were more useful, so we did not bother with the html files.

I am happy to have this particular PR merged now (ahead of the release) if you like. We will still have 3 days to monitor runs before Tuesday, so the intent was locking the repo down later tonight.

@llxia
Copy link
Contributor Author

llxia commented Apr 15, 2019

Sorry Shelley, missed your msg last Friday. I am ok to merge it before release. Removing WIP.

@llxia llxia changed the title WIP: Archive openjdk regression tests output including diagnostic files Archive openjdk regression tests output including diagnostic files Apr 15, 2019
@smlambert
Copy link
Contributor

Its not a problem to wait either (now that we are so close to the release, I will say we wait), also, since PR is still pending @sophia-guo 's review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Failed tests delete diagnostic (core/trace/javacore) files (or moved to an unknown location)
4 participants