Add QuarkusMainTest and QuarkusMainIntegrationTest #19891

stuartwdouglas · 2021-09-03T03:44:42Z

These allow you to test running a command mode application to
completion, and verify the outcome.

Also coverts the Picocli tests to use this, rather than testing using a
rest endpoint.

quarkus-bot · 2021-09-03T10:52:58Z

This workflow status is outdated as a new workflow run has been triggered.

Failing Jobs - Building `5c63f10`

Status	Name	Step	Failures	Logs	Raw logs
✖	Gradle Tests - JDK 11 Windows	`Build`	Failures	Logs	Raw logs
✖	JVM Tests - JDK 11	`Build`	Failures	Logs	Raw logs
✖	JVM Tests - JDK 11 Windows	`Build`	Failures	Logs	Raw logs
✖	JVM Tests - JDK 16	`Build`	Failures	Logs	Raw logs

Full information is available in the Build summary check run.

Failures

⚙️ Gradle Tests - JDK 11 Windows #

- Failing: integration-tests/gradle

📦 integration-tests/gradle

✖ io.quarkus.gradle.devmode.QuarkusDevDependencyDevModeTest.main line 14 - More details - Source on GitHub

org.awaitility.core.ConditionTimeoutException: Condition with lambda expression in io.quarkus.test.devmode.util.DevModeTestUtils that uses java.util.function.Supplier, java.util.function.Supplierjava.util.concurrent.atomic.AtomicReference, java.util.concurrent.atomic.AtomicReferencejava.lang.String, java.lang.Stringboolean was not fulfilled within 1 minutes.
	at org.awaitility.core.ConditionAwaiter.await(ConditionAwaiter.java:166)
	at org.awaitility.core.CallableCondition.await(CallableCondition.java:78)

⚙️ JVM Tests - JDK 11 #

- Failing: extensions/hibernate-orm/deployment 
! Skipped: docs extensions/hibernate-envers/deployment extensions/hibernate-reactive/deployment and 82 more

📦 extensions/hibernate-orm/deployment

✖ io.quarkus.hibernate.orm.HibernateHotReloadTestCase.testImportSqlWithContinuousTesting line 99 - More details - Source on GitHub

org.awaitility.core.ConditionTimeoutException: Failed to wait for test run 2 State{lastRun=1, running=true, inProgress=false, run=1, passed=1, failed=0, skipped=0, isBrokenOnly=false, isTestOutput=false, isInstrumentationBasedReload=false, isLiveReload=true}
	at io.quarkus.test.ContinuousTestingTestUtils.waitForNextCompletion(ContinuousTestingTestUtils.java:43)
	at io.quarkus.hibernate.orm.HibernateHotReloadTestCase.testImportSqlWithContinuousTesting(HibernateHotReloadTestCase.java:99)

⚙️ JVM Tests - JDK 11 Windows #

- Failing: integration-tests/smallrye-config

📦 integration-tests/smallrye-config

✖ io.quarkus.it.smallrye.config.FallbackLocationsTest.fallback - More details - Source on GitHub

java.lang.RuntimeException: java.lang.ExceptionInInitializerError
	at io.quarkus.test.junit.QuarkusTestExtension.throwBootFailureException(QuarkusTestExtension.java:578)
	at io.quarkus.test.junit.QuarkusTestExtension.interceptTestClassConstructor(QuarkusTestExtension.java:651)

✖ io.quarkus.it.smallrye.config.HibernatePropertiesTest.properties - More details - Source on GitHub

java.lang.RuntimeException: java.lang.ExceptionInInitializerError
	at io.quarkus.test.junit.QuarkusTestExtension.throwBootFailureException(QuarkusTestExtension.java:578)
	at io.quarkus.test.junit.QuarkusTestExtension.interceptTestClassConstructor(QuarkusTestExtension.java:651)

✖ io.quarkus.it.smallrye.config.QuarkusTestProfileTest.testProfile - More details - Source on GitHub

java.lang.RuntimeException: java.lang.ExceptionInInitializerError
	at io.quarkus.test.junit.QuarkusTestExtension.throwBootFailureException(QuarkusTestExtension.java:578)
	at io.quarkus.test.junit.QuarkusTestExtension.interceptTestClassConstructor(QuarkusTestExtension.java:651)

✖ io.quarkus.it.smallrye.config.ServerResourceTest. - More details - Source on GitHub

java.lang.RuntimeException: java.lang.ExceptionInInitializerError
	at io.quarkus.test.junit.QuarkusTestExtension.throwBootFailureException(QuarkusTestExtension.java:578)
	at io.quarkus.test.junit.QuarkusTestExtension.interceptBeforeAllMethod(QuarkusTestExtension.java:635)

⚙️ JVM Tests - JDK 16 #

- Failing: integration-tests/smallrye-config

📦 integration-tests/smallrye-config

✖ io.quarkus.it.smallrye.config.AppConfigMockTest.mockAppConfig - More details - Source on GitHub

java.lang.RuntimeException: java.lang.ExceptionInInitializerError
	at io.quarkus.test.junit.QuarkusTestExtension.throwBootFailureException(QuarkusTestExtension.java:578)
	at io.quarkus.test.junit.QuarkusTestExtension.interceptTestClassConstructor(QuarkusTestExtension.java:651)

✖ io.quarkus.it.smallrye.config.ConfigurableSourceTest.configurableSource - More details - Source on GitHub

java.lang.RuntimeException: java.lang.ExceptionInInitializerError
	at io.quarkus.test.junit.QuarkusTestExtension.throwBootFailureException(QuarkusTestExtension.java:578)
	at io.quarkus.test.junit.QuarkusTestExtension.interceptTestClassConstructor(QuarkusTestExtension.java:651)

✖ io.quarkus.it.smallrye.config.FallbackLocationsTest.fallback - More details - Source on GitHub

java.lang.RuntimeException: java.lang.ExceptionInInitializerError
	at io.quarkus.test.junit.QuarkusTestExtension.throwBootFailureException(QuarkusTestExtension.java:578)
	at io.quarkus.test.junit.QuarkusTestExtension.interceptTestClassConstructor(QuarkusTestExtension.java:651)

✖ io.quarkus.it.smallrye.config.QuarkusTestProfileTest.testProfile - More details - Source on GitHub

java.lang.RuntimeException: java.lang.ExceptionInInitializerError
	at io.quarkus.test.junit.QuarkusTestExtension.throwBootFailureException(QuarkusTestExtension.java:578)
	at io.quarkus.test.junit.QuarkusTestExtension.interceptTestClassConstructor(QuarkusTestExtension.java:651)

docs/src/main/asciidoc/command-mode-reference.adoc

independent-projects/bootstrap/core/src/main/java/io/quarkus/bootstrap/app/StartupAction.java

...ramework/junit5/src/main/java/io/quarkus/test/junit/QuarkusMainIntegrationTestExtension.java

test-framework/common/src/main/java/io/quarkus/test/common/DefaultJarLauncher.java

integration-tests/picocli-native/src/test/java/io/quarkus/it/picocli/PicocliTest.java

quarkus-bot · 2021-09-06T10:35:38Z

This workflow status is outdated as a new workflow run has been triggered.

Failing Jobs - Building `c7b689e`

Status	Name	Step	Failures	Logs	Raw logs
✖	JVM Tests - JDK 11	`Build`	Failures	Logs	Raw logs
✖	JVM Tests - JDK 11 Windows	`Build`	Failures	Logs	Raw logs
✖	JVM Tests - JDK 16	`Build`	Failures	Logs	Raw logs

Full information is available in the Build summary check run.

Failures

⚙️ JVM Tests - JDK 11 #

- Failing: extensions/smallrye-reactive-messaging-kafka/deployment integration-tests/smallrye-config integration-tests/vault-app 
! Skipped: docs integration-tests/kubernetes/quarkus-standard-way-kafka integration-tests/reactive-messaging-kafka and 1 more

📦 extensions/smallrye-reactive-messaging-kafka/deployment

✖ io.quarkus.smallrye.reactivemessaging.kafka.deployment.testing.KafkaDevServicesContinuousTestingTestCase.testContinuousTestingScenario1 line 63 - More details - Source on GitHub

org.awaitility.core.ConditionTimeoutException: Failed to wait for test run 5 State{lastRun=4, running=true, inProgress=false, run=1, passed=0, failed=1, skipped=0, isBrokenOnly=false, isTestOutput=false, isInstrumentationBasedReload=false, isLiveReload=true}
	at io.quarkus.test.ContinuousTestingTestUtils.waitForNextCompletion(ContinuousTestingTestUtils.java:43)
	at io.quarkus.smallrye.reactivemessaging.kafka.deployment.testing.KafkaDevServicesContinuousTestingTestCase.testContinuousTestingScenario1(KafkaDevServicesContinuousTestingTestCase.java:63)

✖ io.quarkus.smallrye.reactivemessaging.kafka.deployment.testing.KafkaDevServicesContinuousTestingTestCase.testContinuousTestingScenario2 line 75 - More details - Source on GitHub

org.awaitility.core.ConditionTimeoutException: Failed to wait for test run 2 State{lastRun=1, running=true, inProgress=false, run=1, passed=0, failed=1, skipped=0, isBrokenOnly=false, isTestOutput=false, isInstrumentationBasedReload=false, isLiveReload=true}
	at io.quarkus.test.ContinuousTestingTestUtils.waitForNextCompletion(ContinuousTestingTestUtils.java:43)
	at io.quarkus.smallrye.reactivemessaging.kafka.deployment.testing.KafkaDevServicesContinuousTestingTestCase.testContinuousTestingScenario2(KafkaDevServicesContinuousTestingTestCase.java:75)

📦 integration-tests/smallrye-config

✖ io.quarkus.it.smallrye.config.HibernatePropertiesTest.properties line 41 - More details - Source on GitHub

java.lang.AssertionError: 
1 expectation failed.
Expected status code <200> but was <500>.

✖ io.quarkus.it.smallrye.config.SmallRyeConfigTest.properties line 49 - More details - Source on GitHub

java.lang.AssertionError: 
1 expectation failed.
JSON path value doesn't match.

📦 integration-tests/vault-app

✖ io.quarkus.it.vault.VaultTest.test - More details - Source on GitHub

java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
	at io.quarkus.test.junit.QuarkusTestExtension.throwBootFailureException(QuarkusTestExtension.java:578)
	at io.quarkus.test.junit.QuarkusTestExtension.interceptTestClassConstructor(QuarkusTestExtension.java:651)

⚙️ JVM Tests - JDK 11 Windows #

- Failing: integration-tests/smallrye-config

📦 integration-tests/smallrye-config

✖ io.quarkus.it.smallrye.config.HibernatePropertiesTest.properties line 41 - More details - Source on GitHub

java.lang.AssertionError: 
1 expectation failed.
Expected status code <200> but was <500>.

✖ io.quarkus.it.smallrye.config.SmallRyeConfigTest.properties line 49 - More details - Source on GitHub

java.lang.AssertionError: 
1 expectation failed.
JSON path value doesn't match.

⚙️ JVM Tests - JDK 16 #

- Failing: integration-tests/smallrye-config

📦 integration-tests/smallrye-config

✖ io.quarkus.it.smallrye.config.HibernatePropertiesTest.properties line 41 - More details - Source on GitHub

java.lang.AssertionError: 
1 expectation failed.
Expected status code <200> but was <500>.

✖ io.quarkus.it.smallrye.config.SmallRyeConfigTest.properties line 49 - More details - Source on GitHub

java.lang.AssertionError: 
1 expectation failed.
JSON path value doesn't match.

quarkus-bot · 2021-09-07T03:44:38Z

This workflow status is outdated as a new workflow run has been triggered.

Failing Jobs - Building `322a93f`

Status	Name	Step	Failures	Logs	Raw logs
✖	JVM Tests - JDK 11	`Build`	Failures	Logs	Raw logs
✖	JVM Tests - JDK 16	`Build`	Failures	Logs	Raw logs
✖	MicroProfile TCKs Tests	`Verify`	Failures	Logs	Raw logs

Full information is available in the Build summary check run.

Failures

⚙️ JVM Tests - JDK 11 #

- Failing: extensions/vertx-http/deployment 
! Skipped: core/test-extension/deployment docs extensions/agroal/deployment and 286 more

📦 extensions/vertx-http/deployment

✖ io.quarkus.vertx.http.testrunner.includes.IncludePatternTestCase.checkTestsAreRun line 65 - More details - Source on GitHub

org.awaitility.core.ConditionTimeoutException: Failed to wait for test run 3 State{lastRun=2, running=true, inProgress=false, run=2, passed=2, failed=0, skipped=0, isBrokenOnly=false, isTestOutput=false, isInstrumentationBasedReload=false, isLiveReload=true}
	at io.quarkus.test.ContinuousTestingTestUtils.waitForNextCompletion(ContinuousTestingTestUtils.java:43)
	at io.quarkus.vertx.http.testrunner.includes.IncludePatternTestCase.checkTestsAreRun(IncludePatternTestCase.java:65)

⚙️ JVM Tests - JDK 16 #

- Failing: extensions/vertx-http/deployment 
! Skipped: core/test-extension/deployment docs extensions/agroal/deployment and 286 more

📦 extensions/vertx-http/deployment

✖ io.quarkus.vertx.http.testrunner.tags.ExcludeTagsTestCase.checkTestsAreRun line 54 - More details - Source on GitHub

org.awaitility.core.ConditionTimeoutException: Failed to wait for test run 2 State{lastRun=1, running=true, inProgress=false, run=3, passed=3, failed=0, skipped=0, isBrokenOnly=false, isTestOutput=false, isInstrumentationBasedReload=false, isLiveReload=true}
	at io.quarkus.test.ContinuousTestingTestUtils.waitForNextCompletion(ContinuousTestingTestUtils.java:43)
	at io.quarkus.vertx.http.testrunner.tags.ExcludeTagsTestCase.checkTestsAreRun(ExcludeTagsTestCase.java:54)

⚙️ MicroProfile TCKs Tests #

- Failing: tcks/resteasy-reactive

📦 tcks/resteasy-reactive

✖ Failed to execute goal org.codehaus.mojo:exec-maven-plugin:3.0.0:exec (test) on project quarkus-tck-resteasy-reactive: Command execution failed.

📦 tcks/resteasy-reactive/target/testsuite/tests

✖ com.sun.ts.tests.jaxrs.platform.container.completioncallback.JAXRSClient0164.argumentIsNullWhenRegistredClassTest line 209 - More details - Source on GitHub

com.sun.ts.tests.jaxrs.common.JAXRSCommonClient$Fault: Unexpected response content No name has been set yet expecting NULL
	at com.sun.ts.tests.jaxrs.platform.container.completioncallback.JAXRSClient0164.assertString(JAXRSClient0164.java:458)
	at com.sun.ts.tests.jaxrs.platform.container.completioncallback.JAXRSClient0164.argumentIsNullWhenRegistredClassTest(JAXRSClient0164.java:209)

These allow you to test running a command mode application to completion, and verify the outcome. Also coverts the Picocli tests to use this, rather than testing using a rest endpoint.

quarkus-bot · 2021-09-07T08:59:36Z

Failing Jobs - Building `c3baf65`

Status	Name	Step	Failures	Logs	Raw logs
✔️	JVM Tests - JDK 11
✖	JVM Tests - JDK 11 Windows	`Build`	Failures	Logs	Raw logs
✔️	JVM Tests - JDK 16

Full information is available in the Build summary check run.

Failures

⚙️ JVM Tests - JDK 11 Windows #

- Failing: extensions/smallrye-reactive-messaging-amqp/deployment 
! Skipped: docs integration-tests/reactive-messaging-amqp

📦 extensions/smallrye-reactive-messaging-amqp/deployment

✖ io.quarkus.smallrye.reactivemessaging.amqp.AnonymousAmqpTest.test line 30 - More details - Source on GitHub

org.awaitility.core.ConditionTimeoutException: Condition with io.quarkus.smallrye.reactivemessaging.amqp.AnonymousAmqpTest was not fulfilled within 1 minutes.
	at org.awaitility.core.ConditionAwaiter.await(ConditionAwaiter.java:166)
	at org.awaitility.core.CallableCondition.await(CallableCondition.java:78)

stuartwdouglas · 2021-09-07T09:45:03Z

I can't really see how this failure would be related, it was not on any previous runs.

stuartwdouglas requested a review from ebullient September 3, 2021 03:44

quarkus-bot bot added area/core area/devtools Issues/PR related to maven, gradle, platform and cli tooling/plugins area/documentation area/picocli area/platform Issues related to definition and interaction with Quarkus Platform area/testing labels Sep 3, 2021

stuartwdouglas force-pushed the quarkus-main-test branch from 0b829af to 5c63f10 Compare September 3, 2021 06:46

ebullient approved these changes Sep 3, 2021

View reviewed changes

stuartwdouglas force-pushed the quarkus-main-test branch 2 times, most recently from 5bb51c3 to c7b689e Compare September 6, 2021 06:17

stuartwdouglas force-pushed the quarkus-main-test branch from c7b689e to 322a93f Compare September 7, 2021 00:10

Add QuarkusMainTest and QuarkusMainIntegrationTest

c3baf65

These allow you to test running a command mode application to completion, and verify the outcome. Also coverts the Picocli tests to use this, rather than testing using a rest endpoint.

stuartwdouglas force-pushed the quarkus-main-test branch from 322a93f to c3baf65 Compare September 7, 2021 04:47

stuartwdouglas merged commit 4b728c8 into quarkusio:main Sep 7, 2021

quarkus-bot bot added this to the 2.3 - main milestone Sep 7, 2021

stuartwdouglas added the release/noteworthy-feature label Sep 7, 2021

geoand mentioned this pull request Sep 7, 2021

@QuarkusMain not called from @QuarkusTest #19957

Closed

ebullient mentioned this pull request Sep 7, 2021

Add QuarkusMainTest for testing CLI applications #19792

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add QuarkusMainTest and QuarkusMainIntegrationTest #19891

Add QuarkusMainTest and QuarkusMainIntegrationTest #19891

stuartwdouglas commented Sep 3, 2021

quarkus-bot bot commented Sep 3, 2021 •

edited

Loading

Failing Jobs - Building `5c63f10`

Failures

⚙️ Gradle Tests - JDK 11 Windows #

📦 integration-tests/gradle

⚙️ JVM Tests - JDK 11 #

📦 extensions/hibernate-orm/deployment

⚙️ JVM Tests - JDK 11 Windows #

📦 integration-tests/smallrye-config

⚙️ JVM Tests - JDK 16 #

📦 integration-tests/smallrye-config

quarkus-bot bot commented Sep 6, 2021 •

edited

Loading

Failing Jobs - Building `c7b689e`

Failures

⚙️ JVM Tests - JDK 11 #

📦 extensions/smallrye-reactive-messaging-kafka/deployment

📦 integration-tests/smallrye-config

📦 integration-tests/vault-app

⚙️ JVM Tests - JDK 11 Windows #

📦 integration-tests/smallrye-config

⚙️ JVM Tests - JDK 16 #

📦 integration-tests/smallrye-config

quarkus-bot bot commented Sep 7, 2021 •

edited

Loading

Failing Jobs - Building `322a93f`

Failures

⚙️ JVM Tests - JDK 11 #

📦 extensions/vertx-http/deployment

⚙️ JVM Tests - JDK 16 #

📦 extensions/vertx-http/deployment

⚙️ MicroProfile TCKs Tests #

📦 tcks/resteasy-reactive

📦 tcks/resteasy-reactive/target/testsuite/tests

quarkus-bot bot commented Sep 7, 2021

stuartwdouglas commented Sep 7, 2021

Add QuarkusMainTest and QuarkusMainIntegrationTest #19891

Add QuarkusMainTest and QuarkusMainIntegrationTest #19891

Conversation

stuartwdouglas commented Sep 3, 2021

quarkus-bot bot commented Sep 3, 2021 • edited Loading

Failing Jobs - Building 5c63f10

Failures

⚙️ Gradle Tests - JDK 11 Windows #

📦 integration-tests/gradle

⚙️ JVM Tests - JDK 11 #

📦 extensions/hibernate-orm/deployment

⚙️ JVM Tests - JDK 11 Windows #

📦 integration-tests/smallrye-config

⚙️ JVM Tests - JDK 16 #

📦 integration-tests/smallrye-config

quarkus-bot bot commented Sep 6, 2021 • edited Loading

Failing Jobs - Building c7b689e

Failures

⚙️ JVM Tests - JDK 11 #

📦 extensions/smallrye-reactive-messaging-kafka/deployment

📦 integration-tests/smallrye-config

📦 integration-tests/vault-app

⚙️ JVM Tests - JDK 11 Windows #

📦 integration-tests/smallrye-config

⚙️ JVM Tests - JDK 16 #

📦 integration-tests/smallrye-config

quarkus-bot bot commented Sep 7, 2021 • edited Loading

Failing Jobs - Building 322a93f

Failures

⚙️ JVM Tests - JDK 11 #

📦 extensions/vertx-http/deployment

⚙️ JVM Tests - JDK 16 #

📦 extensions/vertx-http/deployment

⚙️ MicroProfile TCKs Tests #

📦 tcks/resteasy-reactive

📦 tcks/resteasy-reactive/target/testsuite/tests

quarkus-bot bot commented Sep 7, 2021

Failing Jobs - Building c3baf65

Failures

⚙️ JVM Tests - JDK 11 Windows #

📦 extensions/smallrye-reactive-messaging-amqp/deployment

stuartwdouglas commented Sep 7, 2021

quarkus-bot bot commented Sep 3, 2021 •

edited

Loading

Failing Jobs - Building `5c63f10`

quarkus-bot bot commented Sep 6, 2021 •

edited

Loading

Failing Jobs - Building `c7b689e`

quarkus-bot bot commented Sep 7, 2021 •

edited

Loading

Failing Jobs - Building `322a93f`

Failing Jobs - Building `c3baf65`