HBASE-24049 use hadoop-2.10.0 for "packaging and integration" check #1368

ndimiduk · 2020-03-26T23:37:13Z

No description provided.

ndimiduk · 2020-03-26T23:39:40Z

We only run this check on nightly, so pushed a feature branch, https://builds.apache.org/job/HBase%20Nightly/job/HBASE-24049-packaging-integration-hadoop-2.10.0/

Apache-HBase · 2020-03-26T23:47:32Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 28s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+0 🆗	shelldocs	0m 0s	Shelldocs was not available.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ master Compile Tests _
+0 🆗	mvndep	0m 36s	Maven dependency ordering for branch
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 10s	Maven dependency ordering for patch
+1 💚	shellcheck	0m 0s	There were no new shellcheck issues.
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
		_ Other Tests _
+0 🆗	asflicense	0m 1s	ASF License check generated no output?
		2m 21s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests	dupname asflicense shellcheck shelldocs
uname	Linux 0f2c71021e73 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `78eecd3`
Max. process+thread count	50 (vs. ulimit of 10000)
modules	C: U:
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/1/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z) shellcheck=0.4.6
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-03-26T23:48:04Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 16s	Docker mode activated.
-0 ⚠️	yetus	0m 2s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+0 🆗	mvndep	0m 33s	Maven dependency ordering for branch
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 9s	Maven dependency ordering for patch
		_ Other Tests _
		2m 51s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests
uname	Linux aeed3f4ca11c 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `78eecd3`
Max. process+thread count	57 (vs. ulimit of 10000)
modules	C: U:
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/1/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-03-26T23:48:15Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 28s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+0 🆗	mvndep	0m 33s	Maven dependency ordering for branch
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 9s	Maven dependency ordering for patch
		_ Other Tests _
		3m 4s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests
uname	Linux c6a7e0fd13dd 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `78eecd3`
Max. process+thread count	47 (vs. ulimit of 10000)
modules	C: U:
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/1/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

virajjasani

+1

busbey · 2020-03-27T17:46:04Z

has this been tested locally already?

ndimiduk · 2020-03-27T19:12:56Z

has this been tested locally already?

No, I'm testing via the nightly job.

busbey · 2020-03-27T19:54:10Z

has this been tested locally already?

No, I'm testing via the nightly job.

Okay cool. I'd like to see it pass prior to merge.

did jenkins run number 2 time out or did someone abort it? I can't tell from the jenkins UI.

ndimiduk · 2020-03-27T20:51:56Z

did jenkins run number 2 time out or did someone abort it? I can't tell from the jenkins UI.

2 was manually killed due to someone doing some aggressive pruning. It's easier to tell from the jenkins console than from BlueOcean.

ndimiduk · 2020-03-27T22:29:33Z

This is still broken. "packaging & integration" took 3.5 mins on master/1620, this one is been running for hours...

ndimiduk · 2020-03-27T22:54:02Z

From the log, I see

Exception in thread "main" java.lang.NoClassDefFoundError: com/ctc/wstx/io/InputBootstrapper
	at org.apache.hadoop.hbase.util.HBaseConfTool.main(HBaseConfTool.java:39)
Caused by: java.lang.ClassNotFoundException: com.ctc.wstx.io.InputBootstrapper
	at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:355)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
	... 1 more

busbey · 2020-03-27T22:59:25Z

Are we getting that in a loop? Oof.

ndimiduk · 2020-03-27T23:38:35Z

Okay, unpacked all this to run locally.

Now looking in outputput-integration/hadoop-2/hadoop_cluster_command.err is see a stack looped over

20/03/27 16:30:08 ERROR delegation.AbstractDelegationTokenSecretManager: ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/server/timelineservice/collector/TimelineCollectorManager
	at org.apache.hadoop.yarn.server.MiniYARNCluster.startResourceManager(MiniYARNCluster.java:372)
	at org.apache.hadoop.yarn.server.MiniYARNCluster.access$300(MiniYARNCluster.java:128)
	at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceStart(MiniYARNCluster.java:502)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
	at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:121)
	at org.apache.hadoop.yarn.server.MiniYARNCluster.serviceStart(MiniYARNCluster.java:321)
	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
	at org.apache.hadoop.mapred.MiniMRClientClusterFactory.create(MiniMRClientClusterFactory.java:80)
	at org.apache.hadoop.mapred.MiniMRClientClusterFactory.create(MiniMRClientClusterFactory.java:41)
	at org.apache.hadoop.mapreduce.MiniHadoopClusterManager.start(MiniHadoopClusterManager.java:179)
	at org.apache.hadoop.mapreduce.MiniHadoopClusterManager.run(MiniHadoopClusterManager.java:132)
	at org.apache.hadoop.mapreduce.MiniHadoopClusterManager.main(MiniHadoopClusterManager.java:320)

ndimiduk · 2020-03-27T23:41:21Z

I didn't launch with -x, but i guess this comes from

sleep_time=2
until [ -s "${working_dir}/hbase-conf/core-site.xml" ]; do
  printf '\twaiting for Hadoop to finish starting up.\n'
  sleep "${sleep_time}"
  sleep_time="$((sleep_time*2))"
done

Seems there's no check that the timeout was not triggered, so the script progresses after this point into a an untimed wait that locks up the jekinks worker until the 8hr fail-safe is triggered.

ndimiduk · 2020-03-27T23:42:09Z

This matches what I see locally, https://builds.apache.org/job/HBase%20Nightly/job/HBASE-24049-packaging-integration-hadoop-2.10.0/3//artifact/output-integration/hadoop-2/hadoop_cluster_command.err/*view*/

busbey · 2020-03-28T06:47:54Z

How easy is wrapping a single set of steps in their own timeout? Presuming we have enough historical run information to make a good guess on a better time.

ndimiduk · 2020-03-31T00:04:21Z

Making progress. Now getting

$ cat ~/tmp/packaging_and_integration/output-integration/hadoop-2/waiting_hbase_startup.log 
NameError: missing class name (`org.apache.hadoop.hbase.HColumnDescriptor')
           method_missing at org/jruby/javasupport/JavaPackage.java:259
  <module:HBaseConstants> at /Users/ndimiduk/tmp/packaging_and_integration/hbase-install/lib/ruby/hbase_constants.rb:42
                   <main> at /Users/ndimiduk/tmp/packaging_and_integration/hbase-install/lib/ruby/hbase_constants.rb:34
                  require at org/jruby/RubyKernel.java:956
                   (root) at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1
                   <main> at /Users/ndimiduk/tmp/packaging_and_integration/hbase-install/bin/../bin/hirb.rb:131

ndimiduk · 2020-03-31T00:19:44Z

Bit rot on master...

https://issues.apache.org/jira/browse/HBASE-24084
https://issues.apache.org/jira/browse/HBASE-24085

ndimiduk · 2020-03-31T00:23:17Z

Pushed the automation script changes that were necessary to launch a minicluster.

Apache-HBase · 2020-03-31T00:27:40Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 34s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+0 🆗	mvndep	0m 35s	Maven dependency ordering for branch
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 10s	Maven dependency ordering for patch
		_ Other Tests _
		2m 13s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests
uname	Linux e9c7f56bf799 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `3d4124c`
Max. process+thread count	62 (vs. ulimit of 10000)
modules	C: U:
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/2/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-03-31T00:27:46Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 31s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+0 🆗	shelldocs	0m 0s	Shelldocs was not available.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ master Compile Tests _
+0 🆗	mvndep	0m 35s	Maven dependency ordering for branch
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 10s	Maven dependency ordering for patch
+1 💚	shellcheck	0m 2s	There were no new shellcheck issues.
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
		_ Other Tests _
+0 🆗	asflicense	0m 0s	ASF License check generated no output?
		2m 24s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/2/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests	dupname asflicense shellcheck shelldocs
uname	Linux df13e689bfdd 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `3d4124c`
Max. process+thread count	52 (vs. ulimit of 10000)
modules	C: U:
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/2/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z) shellcheck=0.4.6
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-03-31T00:28:05Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 8s	Docker mode activated.
-0 ⚠️	yetus	0m 2s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+0 🆗	mvndep	0m 32s	Maven dependency ordering for branch
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 9s	Maven dependency ordering for patch
		_ Other Tests _
		2m 41s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/2/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests
uname	Linux b5e1ebbf8ca7 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `3d4124c`
Max. process+thread count	47 (vs. ulimit of 10000)
modules	C: U:
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/2/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-04-01T22:02:35Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 32s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+0 🆗	shelldocs	0m 0s	Shelldocs was not available.
+1 💚	hbaseanti	0m 0s	Patch does not have any anti-patterns.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ master Compile Tests _
+0 🆗	mvndep	0m 36s	Maven dependency ordering for branch
+1 💚	mvninstall	5m 18s	master passed
+1 💚	checkstyle	0m 36s	master passed
+1 💚	spotbugs	0m 43s	master passed
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 13s	Maven dependency ordering for patch
+1 💚	mvninstall	5m 8s	the patch passed
+1 💚	checkstyle	0m 35s	the patch passed
+1 💚	shellcheck	0m 2s	There were no new shellcheck issues.
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	xml	0m 2s	The patch has no ill-formed XML file.
+1 💚	hadoopcheck	10m 22s	Patch does not cause any errors with Hadoop 2.10.0 or 3.1.2.
+1 💚	spotbugs	0m 50s	the patch passed
		_ Other Tests _
+1 💚	asflicense	0m 24s	The patch does not generate ASF License warnings.
		32m 13s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/3/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests	dupname asflicense shellcheck shelldocs xml spotbugs hadoopcheck hbaseanti checkstyle
uname	Linux 2c8add5d9b94 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `040a0a7`
Max. process+thread count	93 (vs. ulimit of 10000)
modules	C: hbase-common hbase-assembly U: .
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/3/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z) shellcheck=0.4.6 spotbugs=3.1.12
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-04-01T23:03:55Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	2m 16s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+0 🆗	mvndep	0m 18s	Maven dependency ordering for branch
+1 💚	mvninstall	5m 47s	master passed
+1 💚	compile	0m 55s	master passed
+1 💚	shadedjars	5m 10s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 34s	master passed
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 16s	Maven dependency ordering for patch
+1 💚	mvninstall	5m 5s	the patch passed
+1 💚	compile	0m 52s	the patch passed
+1 💚	javac	0m 52s	the patch passed
+1 💚	shadedjars	4m 41s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 33s	the patch passed
		_ Other Tests _
+1 💚	unit	1m 6s	hbase-common in the patch passed.
+1 💚	unit	0m 29s	hbase-assembly in the patch passed.
+1 💚	unit	63m 1s	hbase-server in the patch passed.
		93m 25s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/3/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux b990cf5a9495 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `040a0a7`
Default Java	1.8.0_232
Test Results	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/3/testReport/
Max. process+thread count	5683 (vs. ulimit of 10000)
modules	C: hbase-common hbase-assembly U: .
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/3/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-04-01T23:45:54Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 6s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+0 🆗	mvndep	0m 32s	Maven dependency ordering for branch
+1 💚	mvninstall	6m 57s	master passed
+1 💚	compile	1m 1s	master passed
+1 💚	shadedjars	6m 16s	branch has no errors when building our shaded downstream artifacts.
-0 ⚠️	javadoc	0m 16s	hbase-common in master failed.
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 15s	Maven dependency ordering for patch
+1 💚	mvninstall	6m 41s	the patch passed
+1 💚	compile	1m 2s	the patch passed
+1 💚	javac	1m 2s	the patch passed
+1 💚	shadedjars	6m 17s	patch has no errors when building our shaded downstream artifacts.
-0 ⚠️	javadoc	0m 15s	hbase-common in the patch failed.
		_ Other Tests _
+1 💚	unit	1m 18s	hbase-common in the patch passed.
+1 💚	unit	0m 37s	hbase-assembly in the patch passed.
+1 💚	unit	100m 43s	hbase-server in the patch passed.
		135m 29s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/3/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 6fe64dc3f74c 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `040a0a7`
Default Java	2020-01-14
javadoc	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/3/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-common.txt
javadoc	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/3/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-common.txt
Test Results	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/3/testReport/
Max. process+thread count	4119 (vs. ulimit of 10000)
modules	C: hbase-common hbase-assembly U: .
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/3/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-04-02T17:50:50Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 32s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+0 🆗	shelldocs	0m 0s	Shelldocs was not available.
+1 💚	hbaseanti	0m 0s	Patch does not have any anti-patterns.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ master Compile Tests _
+1 💚	mvninstall	5m 11s	master passed
+1 💚	checkstyle	0m 24s	master passed
+1 💚	spotbugs	0m 41s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	4m 58s	the patch passed
+1 💚	checkstyle	0m 24s	the patch passed
+1 💚	shellcheck	0m 2s	There were no new shellcheck issues.
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	hadoopcheck	10m 27s	Patch does not cause any errors with Hadoop 2.10.0 or 3.1.2.
+1 💚	spotbugs	0m 51s	the patch passed
		_ Other Tests _
+1 💚	asflicense	0m 12s	The patch does not generate ASF License warnings.
		30m 26s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/4/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests	dupname asflicense shellcheck shelldocs spotbugs hadoopcheck hbaseanti checkstyle
uname	Linux 7858f5ec2d4a 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `b2c9a06`
Max. process+thread count	93 (vs. ulimit of 10000)
modules	C: hbase-common U: hbase-common
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/4/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z) shellcheck=0.4.6 spotbugs=3.1.12
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-04-02T19:35:37Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 23s	Docker mode activated.
-0 ⚠️	yetus	0m 2s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	6m 5s	master passed
+1 💚	compile	0m 22s	master passed
+1 💚	shadedjars	5m 12s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 21s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	5m 51s	the patch passed
+1 💚	compile	0m 23s	the patch passed
+1 💚	javac	0m 23s	the patch passed
+1 💚	shadedjars	5m 37s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 22s	the patch passed
		_ Other Tests _
+1 💚	unit	1m 34s	hbase-common in the patch passed.
+1 💚	unit	106m 10s	hbase-server in the patch passed.
		135m 10s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/4/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 45631cae8e1a 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `b2c9a06`
Default Java	1.8.0_232
Test Results	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/4/testReport/
Max. process+thread count	3844 (vs. ulimit of 10000)
modules	C: hbase-common U: hbase-common
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/4/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-04-02T20:32:14Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 5s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	7m 2s	master passed
+1 💚	compile	0m 27s	master passed
+1 💚	shadedjars	6m 31s	branch has no errors when building our shaded downstream artifacts.
-0 ⚠️	javadoc	0m 18s	hbase-common in master failed.
		_ Patch Compile Tests _
+1 💚	mvninstall	6m 51s	the patch passed
+1 💚	compile	0m 27s	the patch passed
+1 💚	javac	0m 27s	the patch passed
+1 💚	shadedjars	6m 23s	patch has no errors when building our shaded downstream artifacts.
-0 ⚠️	javadoc	0m 16s	hbase-common in the patch failed.
		_ Other Tests _
+1 💚	unit	1m 32s	hbase-common in the patch passed.
-1 ❌	unit	158m 11s	hbase-server in the patch failed.
		191m 13s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/4/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 43a149294096 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `b2c9a06`
Default Java	2020-01-14
javadoc	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/4/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-common.txt
javadoc	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/4/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-common.txt
unit	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/4/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt
Test Results	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/4/testReport/
Max. process+thread count	4270 (vs. ulimit of 10000)
modules	C: hbase-common U: hbase-common
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/4/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-04-03T21:42:20Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 30s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+0 🆗	mvndep	0m 27s	Maven dependency ordering for branch
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 12s	Maven dependency ordering for patch
		_ Other Tests _
		2m 2s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/5/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests
uname	Linux 6cfb80c2f372 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `10cbb3f`
Max. process+thread count	56 (vs. ulimit of 10000)
modules	C: U:
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/5/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-04-03T21:42:33Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 31s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+0 🆗	shelldocs	0m 0s	Shelldocs was not available.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ master Compile Tests _
+0 🆗	mvndep	0m 24s	Maven dependency ordering for branch
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 13s	Maven dependency ordering for patch
+1 💚	shellcheck	0m 2s	There were no new shellcheck issues.
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
		_ Other Tests _
+0 🆗	asflicense	0m 0s	ASF License check generated no output?
		2m 16s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/5/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests	dupname asflicense shellcheck shelldocs
uname	Linux 6380590cc900 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `10cbb3f`
Max. process+thread count	50 (vs. ulimit of 10000)
modules	C: U:
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/5/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z) shellcheck=0.4.6
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-04-03T21:44:26Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	2m 16s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+0 🆗	mvndep	0m 41s	Maven dependency ordering for branch
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 10s	Maven dependency ordering for patch
		_ Other Tests _
		4m 1s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/5/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests
uname	Linux 229212809f09 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `10cbb3f`
Max. process+thread count	47 (vs. ulimit of 10000)
modules	C: U:
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/5/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

ndimiduk · 2020-04-03T22:42:42Z

Okay we have progress here. After HBASE-24084 and HBASE-24086, we now have this stage completing its Hadoop2 component. Now to see what's going on with Hadoop3.

https://builds.apache.org/blue/organizations/jenkins/HBase%20Nightly/detail/HBASE-24049-packaging-integration-hadoop-2.10.0/5/pipeline/103

Apache-HBase · 2020-04-03T23:22:29Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 32s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+0 🆗	shelldocs	0m 0s	Shelldocs was not available.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ master Compile Tests _
+0 🆗	mvndep	0m 16s	Maven dependency ordering for branch
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 10s	Maven dependency ordering for patch
+1 💚	shellcheck	0m 2s	There were no new shellcheck issues.
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
		_ Other Tests _
+0 🆗	asflicense	0m 0s	ASF License check generated no output?
		2m 6s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/6/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests	dupname asflicense shellcheck shelldocs
uname	Linux d2fc7f53316e 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `10cbb3f`
Max. process+thread count	48 (vs. ulimit of 10000)
modules	C: U:
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/6/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z) shellcheck=0.4.6
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-04-03T23:22:47Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 7s	Docker mode activated.
-0 ⚠️	yetus	0m 2s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+0 🆗	mvndep	0m 14s	Maven dependency ordering for branch
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 9s	Maven dependency ordering for patch
		_ Other Tests _
		2m 21s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/6/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests
uname	Linux 546509bf3407 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `10cbb3f`
Max. process+thread count	43 (vs. ulimit of 10000)
modules	C: U:
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/6/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-04-03T23:23:03Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 13s	Docker mode activated.
-0 ⚠️	yetus	0m 2s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+0 🆗	mvndep	0m 23s	Maven dependency ordering for branch
		_ Patch Compile Tests _
+0 🆗	mvndep	0m 11s	Maven dependency ordering for patch
		_ Other Tests _
		2m 39s

Subsystem	Report/Notes
Docker	Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/6/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#1368
Optional Tests
uname	Linux f0fc8976cad6 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `10cbb3f`
Max. process+thread count	56 (vs. ulimit of 10000)
modules	C: U:
Console output	https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1368/6/console
versions	git=2.17.1 maven=2018-06-17T18:33:14Z)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

ndimiduk · 2020-04-03T23:54:57Z

Okay, the fix is demonstrated in https://builds.apache.org/blue/organizations/jenkins/HBase%20Nightly/detail/HBASE-24049-packaging-integration-hadoop-2.10.0/6/pipeline/103/

Signed-off-by: stack <[email protected]> Signed-off-by: Jan Hentschel <[email protected]> Signed-off-by: Viraj Jasani <[email protected]>

saintstack approved these changes Mar 26, 2020

View reviewed changes

HorizonNet approved these changes Mar 27, 2020

View reviewed changes

virajjasani approved these changes Mar 27, 2020

View reviewed changes

ndimiduk force-pushed the HBASE-24049-packaging-integration-hadoop-2.10.0 branch 2 times, most recently from 9986df3 to 6dbd7de Compare March 31, 2020 00:23

ndimiduk force-pushed the HBASE-24049-packaging-integration-hadoop-2.10.0 branch 2 times, most recently from 60d70e4 to 9251400 Compare April 1, 2020 21:27

ndimiduk force-pushed the HBASE-24049-packaging-integration-hadoop-2.10.0 branch from 9251400 to d75ab5d Compare April 2, 2020 17:17

ndimiduk force-pushed the HBASE-24049-packaging-integration-hadoop-2.10.0 branch from d75ab5d to d1e5af3 Compare April 3, 2020 21:37

ndimiduk force-pushed the HBASE-24049-packaging-integration-hadoop-2.10.0 branch from d1e5af3 to 4646937 Compare April 3, 2020 23:11

HBASE-24049 use hadoop-2.10.0 for "packaging and integration" check

0ba4bdb

Signed-off-by: stack <[email protected]> Signed-off-by: Jan Hentschel <[email protected]> Signed-off-by: Viraj Jasani <[email protected]>

ndimiduk force-pushed the HBASE-24049-packaging-integration-hadoop-2.10.0 branch from 4646937 to 0ba4bdb Compare April 3, 2020 23:56

ndimiduk merged commit ea69b87 into apache:master Apr 3, 2020

ndimiduk deleted the HBASE-24049-packaging-integration-hadoop-2.10.0 branch April 3, 2020 23:57

HBASE-24049 use hadoop-2.10.0 for "packaging and integration" check #1368

HBASE-24049 use hadoop-2.10.0 for "packaging and integration" check #1368

Conversation

ndimiduk commented Mar 26, 2020

ndimiduk commented Mar 26, 2020

Apache-HBase commented Mar 26, 2020

Apache-HBase commented Mar 26, 2020

Apache-HBase commented Mar 26, 2020

virajjasani left a comment

Choose a reason for hiding this comment

busbey commented Mar 27, 2020

ndimiduk commented Mar 27, 2020

busbey commented Mar 27, 2020 • edited Loading

ndimiduk commented Mar 27, 2020

ndimiduk commented Mar 27, 2020

ndimiduk commented Mar 27, 2020

busbey commented Mar 27, 2020

ndimiduk commented Mar 27, 2020

ndimiduk commented Mar 27, 2020

ndimiduk commented Mar 27, 2020

busbey commented Mar 28, 2020

ndimiduk commented Mar 31, 2020

ndimiduk commented Mar 31, 2020

ndimiduk commented Mar 31, 2020

Apache-HBase commented Mar 31, 2020

Apache-HBase commented Mar 31, 2020

Apache-HBase commented Mar 31, 2020

Apache-HBase commented Apr 1, 2020

Apache-HBase commented Apr 1, 2020

Apache-HBase commented Apr 1, 2020

Apache-HBase commented Apr 2, 2020

Apache-HBase commented Apr 2, 2020

Apache-HBase commented Apr 2, 2020

Apache-HBase commented Apr 3, 2020

Apache-HBase commented Apr 3, 2020

Apache-HBase commented Apr 3, 2020

ndimiduk commented Apr 3, 2020

Apache-HBase commented Apr 3, 2020

Apache-HBase commented Apr 3, 2020

Apache-HBase commented Apr 3, 2020

ndimiduk commented Apr 3, 2020

busbey commented Mar 27, 2020 •

edited

Loading