TestQueryTracker.testInterruptApplyFilter is flaky #8432

kokosing · 2021-06-30T13:09:53Z

2021-06-30T12:05:14.5160337Z org.testng.internal.thread.ThreadTimeoutException: Method io.trino.execution.TestQueryTracker.testInterruptApplyFilter() didn't finish within the time-out 5000
2021-06-30T12:05:14.5162691Z 	at [email protected]/java.net.SocketInputStream.socketRead0(Native Method)
2021-06-30T12:05:14.5166376Z 	at [email protected]/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
2021-06-30T12:05:14.5167620Z 	at [email protected]/java.net.SocketInputStream.read(SocketInputStream.java:168)
2021-06-30T12:05:14.5168754Z 	at [email protected]/java.net.SocketInputStream.read(SocketInputStream.java:140)
2021-06-30T12:05:14.5169543Z 	at app//okio.Okio$2.read(Okio.java:140)
2021-06-30T12:05:14.5170114Z 	at app//okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-06-30T12:05:14.5171004Z 	at app//okio.RealBufferedSource.indexOf(RealBufferedSource.java:358)
2021-06-30T12:05:14.5172308Z 	at app//okio.RealBufferedSource.readUtf8LineStrict(RealBufferedSource.java:230)
2021-06-30T12:05:14.5173992Z 	at app//okhttp3.internal.http1.Http1ExchangeCodec.readHeaderLine(Http1ExchangeCodec.java:242)
2021-06-30T12:05:14.5176310Z 	at app//okhttp3.internal.http1.Http1ExchangeCodec.readResponseHeaders(Http1ExchangeCodec.java:213)
2021-06-30T12:05:14.5178454Z 	at app//okhttp3.internal.connection.Exchange.readResponseHeaders(Exchange.java:115)
2021-06-30T12:05:14.5181437Z 	at app//okhttp3.internal.http.CallServerInterceptor.intercept(CallServerInterceptor.java:94)
2021-06-30T12:05:14.5190569Z 	at app//okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:142)
2021-06-30T12:05:14.5192472Z 	at app//okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:43)
2021-06-30T12:05:14.5194330Z 	at app//okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:142)
2021-06-30T12:05:14.5196092Z 	at app//okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:117)
2021-06-30T12:05:14.5197773Z 	at app//okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:94)
2021-06-30T12:05:14.5219330Z 	at app//okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:142)
2021-06-30T12:05:14.5221108Z 	at app//okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:117)
2021-06-30T12:05:14.5222812Z 	at app//okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93)
2021-06-30T12:05:14.5224515Z 	at app//okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:142)
2021-06-30T12:05:14.5226868Z 	at app//okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:88)
2021-06-30T12:05:14.5228938Z 	at app//okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:142)
2021-06-30T12:05:14.5230682Z 	at app//okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:117)
2021-06-30T12:05:14.5232308Z 	at app//okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:229)
2021-06-30T12:05:14.5233407Z 	at app//okhttp3.RealCall.execute(RealCall.java:81)
2021-06-30T12:05:14.5234311Z 	at app//io.trino.client.JsonResponse.execute(JsonResponse.java:130)
2021-06-30T12:05:14.5235533Z 	at app//io.trino.client.StatementClientV1.advance(StatementClientV1.java:372)
2021-06-30T12:05:14.5237184Z 	at app//io.trino.testing.AbstractTestingTrinoClient.execute(AbstractTestingTrinoClient.java:97)
2021-06-30T12:05:14.5239151Z 	at app//io.trino.testing.AbstractTestingTrinoClient.execute(AbstractTestingTrinoClient.java:85)
2021-06-30T12:05:14.5241047Z 	at app//io.trino.testing.DistributedQueryRunner.execute(DistributedQueryRunner.java:464)
2021-06-30T12:05:14.5242754Z 	at app//io.trino.execution.TestQueryTracker.lambda$testInterruptApplyFilter$0(TestQueryTracker.java:85)
2021-06-30T12:05:14.5244279Z 	at app//io.trino.execution.TestQueryTracker$$Lambda$7168/0x00000008037c3040.call(Unknown Source)
2021-06-30T12:05:14.5245656Z 	at app//org.assertj.core.api.ThrowableAssert.catchThrowable(ThrowableAssert.java:62)
2021-06-30T12:05:14.5247611Z 	at app//org.assertj.core.api.AssertionsForClassTypes.catchThrowable(AssertionsForClassTypes.java:877)
2021-06-30T12:05:14.5249398Z 	at app//org.assertj.core.api.Assertions.catchThrowable(Assertions.java:1306)
2021-06-30T12:05:14.5250858Z 	at app//org.assertj.core.api.Assertions.assertThatThrownBy(Assertions.java:1178)
2021-06-30T12:05:14.5252694Z 	at app//io.trino.execution.TestQueryTracker.testInterruptApplyFilter(TestQueryTracker.java:85)
2021-06-30T12:05:14.5254609Z 	at [email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2021-06-30T12:05:14.5256476Z 	at [email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2021-06-30T12:05:14.5258644Z 	at [email protected]/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2021-06-30T12:05:14.5260253Z 	at [email protected]/java.lang.reflect.Method.invoke(Method.java:566)
2021-06-30T12:05:14.5261732Z 	at app//org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:104)
2021-06-30T12:05:14.5263561Z 	at app//org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:54)
2021-06-30T12:05:14.5265145Z 	at app//org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:44)
2021-06-30T12:05:14.5266476Z 	at [email protected]/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
2021-06-30T12:05:14.5279107Z 	at [email protected]/java.util.concurrent.FutureTask.run(FutureTask.java:264)
2021-06-30T12:05:14.5280558Z 	at [email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
2021-06-30T12:05:14.5282164Z 	at [email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-06-30T12:05:14.5293251Z 	at [email protected]/java.lang.Thread.run(Thread.java:829)
2021-06-30T12:05:14.5293696Z 
2021-06-30T12:05:14.5310347Z 2021-06-30T07:05:14.529-0500 INFO JVM is shutting down, cleaning up
2021-06-30T12:05:14.5315563Z 2021-06-30T07:05:14.529-0500 INFO Life cycle stopping...
2021-06-30T12:05:14.5325466Z 2021-06-30T07:05:14.530-0500 SEVERE Exception in PreDestroy method io.trino.memory.ClusterMemoryManager::destroy()
2021-06-30T12:05:14.5335352Z org.weakref.jmx.JmxException: MBean not found: io.trino.memory:type=ClusterMemoryPool,name=general
2021-06-30T12:05:14.5341377Z 	at org.weakref.jmx.MBeanExporter.unexport(MBeanExporter.java:170)
2021-06-30T12:05:14.5347340Z 	at org.weakref.jmx.MBeanExporter.unexport(MBeanExporter.java:155)
2021-06-30T12:05:14.5354681Z 	at org.weakref.jmx.MBeanExporter.unexportWithGeneratedName(MBeanExporter.java:143)
2021-06-30T12:05:14.5362178Z 	at io.trino.memory.ClusterMemoryManager.lambda$destroy$4(ClusterMemoryManager.java:534)
2021-06-30T12:05:14.5367798Z 	at com.google.common.io.Closer.close(Closer.java:213)
2021-06-30T12:05:14.5374394Z 	at io.trino.memory.ClusterMemoryManager.destroy(ClusterMemoryManager.java:537)
2021-06-30T12:05:14.5381179Z 	at jdk.internal.reflect.GeneratedMethodAccessor4309.invoke(Unknown Source)
2021-06-30T12:05:14.5390258Z 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2021-06-30T12:05:14.5396459Z 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
2021-06-30T12:05:14.5403178Z 	at io.airlift.bootstrap.LifeCycleManager.stopInstance(LifeCycleManager.java:225)
2021-06-30T12:05:14.5413334Z 	at io.airlift.bootstrap.LifeCycleManager.stop(LifeCycleManager.java:193)
2021-06-30T12:05:14.5422798Z 	at io.airlift.bootstrap.LifeCycleManager.stop(LifeCycleManager.java:158)
2021-06-30T12:05:14.5430475Z 	at io.airlift.bootstrap.LifeCycleManager.lambda$start$0(LifeCycleManager.java:111)
2021-06-30T12:05:14.5435675Z 	at java.base/java.lang.Thread.run(Thread.java:829)
2021-06-30T12:05:14.5437171Z 
2021-06-30T12:05:14.5441934Z 2021-06-30T07:05:14.532-0500 INFO Life cycle stopped
2021-06-30T12:05:14.5446968Z 2021-06-30T07:05:14.532-0500 SEVERE Trying to shut down
2021-06-30T12:05:14.5453625Z io.airlift.bootstrap.LifeCycleStopException: Exceptions occurred during lifecycle stop
2021-06-30T12:05:14.5459883Z 	at io.airlift.bootstrap.LifeCycleManager.stop(LifeCycleManager.java:164)
2021-06-30T12:05:14.5466417Z 	at io.airlift.bootstrap.LifeCycleManager.lambda$start$0(LifeCycleManager.java:111)
2021-06-30T12:05:14.5470926Z 	at java.base/java.lang.Thread.run(Thread.java:829)
2021-06-30T12:05:14.5472417Z 
2021-06-30T12:05:14.5477286Z 2021-06-30T07:05:14.540-0500 INFO JVM is shutting down, cleaning up
2021-06-30T12:05:14.5481868Z 2021-06-30T07:05:14.541-0500 INFO Life cycle stopping...
2021-06-30T12:05:14.5487618Z 2021-06-30T07:05:14.547-0500 INFO JVM is shutting down, cleaning up
2021-06-30T12:05:14.5492268Z 2021-06-30T07:05:14.547-0500 INFO Life cycle stopping...
2021-06-30T12:05:14.5498474Z 2021-06-30T07:05:14.547-0500 INFO JVM is shutting down, cleaning up
2021-06-30T12:05:14.5503155Z 2021-06-30T07:05:14.547-0500 INFO Life cycle stopping...
2021-06-30T12:05:14.5508541Z 2021-06-30T07:05:14.549-0500 INFO JVM is shutting down, cleaning up
2021-06-30T12:05:14.5513215Z 2021-06-30T07:05:14.549-0500 INFO Life cycle stopping...
2021-06-30T12:05:14.5518703Z 2021-06-30T07:05:14.549-0500 INFO JVM is shutting down, cleaning up
2021-06-30T12:05:14.5523840Z 2021-06-30T07:05:14.549-0500 INFO Life cycle stopping...
2021-06-30T12:05:18.0124757Z [INFO]

The text was updated successfully, but these errors were encountered:

findepi · 2021-07-26T14:10:42Z

https://github.com/trinodb/trino/runs/3161064892 cc @skrzypo987

hashhar · 2021-08-02T17:12:34Z

https://github.com/trinodb/trino/runs/3222424910?check_suite_focus=true

sopel39 · 2021-08-25T08:51:28Z

https://github.com/trinodb/trino/pull/8796/checks?check_run_id=3415035561

findepi · 2021-09-20T13:41:58Z

https://github.com/trinodb/trino/runs/3651537103

findepi · 2021-09-28T12:27:26Z

https://github.com/trinodb/trino/runs/3730496519

findepi · 2021-09-28T12:37:35Z

https://github.com/trinodb/trino/runs/3708593787

ebyhr · 2021-09-29T04:09:49Z

https://github.com/trinodb/trino/runs/3739189723

ebyhr · 2021-09-30T01:55:29Z

https://github.com/trinodb/trino/runs/3750783218

findepi · 2021-10-25T15:38:06Z

https://github.com/trinodb/trino/runs/3997702313?check_suite_focus=true

findepi · 2021-11-09T12:06:59Z

https://github.com/trinodb/trino/runs/4150797863?check_suite_focus=true
cc @skrzypo987

skrzypo987 · 2021-11-10T10:26:06Z

I see this is pretty frequent. I can probably take a look sometime next week.

findepi · 2021-12-06T20:51:17Z

https://github.com/trinodb/trino/runs/4430649022?check_suite_focus=true

findepi · 2021-12-08T10:25:04Z

https://github.com/trinodb/trino/runs/4436027105?check_suite_focus=true cc @skrzypo987

findepi · 2021-12-08T10:30:38Z

https://github.com/trinodb/trino/runs/4433218461?check_suite_focus=true cc @skrzypo987

findepi · 2021-12-08T10:32:23Z

Undoubtedly, this is currently the top flake. cc @nineinchnick

findepi · 2021-12-08T14:28:47Z

https://github.com/trinodb/trino/runs/4455854180?check_suite_focus=true cc @skrzypo987

skrzypo987 · 2021-12-10T11:01:09Z

What is the policy on adding a flake annotation? I tried to reproduce it by any means and failed. And i don't think increasing the timeout will help here.

kokosing · 2021-12-10T11:27:55Z

I am not sure if flaky annotation handles timeouts.

What is the policy on adding a flake annotation?

It goes as regular PR.

And i don't think increasing the timeout will help here.

Have you tried that? Maybe you can increase the timeout and decrease the time in io.trino.testng.services.LogTestDurationListener to capture the stack traces?

Are you able to stress CI enough that reproduce it?

homar · 2021-12-14T10:43:44Z

happened again here https://github.com/trinodb/trino/runs/4508635836?check_suite_focus=true

ebyhr · 2022-01-01T00:31:11Z

https://github.com/trinodb/trino/runs/4673552161

sopel39 · 2022-06-01T18:02:38Z

Last happened on Jan. Closing until someone reopens

kokosing added bug Something isn't working test labels Jun 30, 2021

kokosing mentioned this issue Jun 30, 2021

Minor improvements in testing Hydra #8431

Merged

weiatwork mentioned this issue Jul 7, 2021

Relax the restriction on predicate pushdown over projection #8451

Closed

kokosing mentioned this issue Jul 8, 2021

Added a way to grant/revoke schema privileges from hive metadata #8436

Merged

findepi mentioned this issue Jul 26, 2021

Rename conversion method for consistency #8661

Merged

phd3 mentioned this issue Jul 31, 2021

Handle redirection for Insert, Delete and Update #8683

Merged

hashhar mentioned this issue Aug 2, 2021

Fix incorrect results for aggregation functions on case-sensitive types #8551

Merged

kokosing mentioned this issue Aug 7, 2021

Pin selenium/standalone-chrome-debug docker image version #8815

Merged

hashhar mentioned this issue Aug 27, 2021

Use matches instead of containsAll for stricter assertion #9009

Merged

1 task

findepi mentioned this issue Sep 20, 2021

Test Iceberg split pruning when filtering on partition column #9304

Merged

findepi mentioned this issue Sep 28, 2021

Reuse table information #9397

Merged

findepi mentioned this issue Sep 28, 2021

Fix bug when DELETE ACID block is a DictionaryBlock #9354

Closed

losipiuk mentioned this issue Sep 28, 2021

Do not use CTAS in TestHiveTransactionalTable and relax test assertions in testCommentColumn #9410

Merged

This was referenced Sep 29, 2021

Inline legacyColumnMapping method in Redshift #9407

Merged

Inline legacyColumnMapping method in Druid #9437

Merged

findepi mentioned this issue Oct 25, 2021

Partitioned table tests and fixed #9757

Merged

findepi mentioned this issue Nov 9, 2021

Fix raw types use in Metrics #9912

Merged

hashhar mentioned this issue Dec 3, 2021

Make testShowSchemasLikeWithEscape more resilient #10154

Merged

findepi mentioned this issue Dec 6, 2021

Remove deprecated Constraint.getColumns #10194

Merged

findepi mentioned this issue Dec 8, 2021

Improve NullableValue.toString #10198

Merged

findepi mentioned this issue Dec 8, 2021

Correct TupleDomain conversion to Predicate #10200

Merged

findepi mentioned this issue Dec 8, 2021

Enforce Constraint.predicate's columns always known #10192

Merged

homar mentioned this issue Dec 14, 2021

Fix inserting into transactional table when task_writer_count > 1 #10261

Closed

skrzypo987 mentioned this issue Dec 14, 2021

Increase test timeout #10295

Merged

sopel39 closed this as completed Jun 1, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

TestQueryTracker.testInterruptApplyFilter is flaky #8432

TestQueryTracker.testInterruptApplyFilter is flaky #8432

kokosing commented Jun 30, 2021

findepi commented Jul 26, 2021

hashhar commented Aug 2, 2021

sopel39 commented Aug 25, 2021

findepi commented Sep 20, 2021

findepi commented Sep 28, 2021

findepi commented Sep 28, 2021

ebyhr commented Sep 29, 2021

ebyhr commented Sep 30, 2021

findepi commented Oct 25, 2021

findepi commented Nov 9, 2021

skrzypo987 commented Nov 10, 2021

findepi commented Dec 6, 2021

findepi commented Dec 8, 2021

findepi commented Dec 8, 2021

findepi commented Dec 8, 2021

findepi commented Dec 8, 2021

skrzypo987 commented Dec 10, 2021

kokosing commented Dec 10, 2021

homar commented Dec 14, 2021

ebyhr commented Jan 1, 2022

sopel39 commented Jun 1, 2022

TestQueryTracker.testInterruptApplyFilter is flaky #8432

TestQueryTracker.testInterruptApplyFilter is flaky #8432

Comments

kokosing commented Jun 30, 2021

findepi commented Jul 26, 2021

hashhar commented Aug 2, 2021

sopel39 commented Aug 25, 2021

findepi commented Sep 20, 2021

findepi commented Sep 28, 2021

findepi commented Sep 28, 2021

ebyhr commented Sep 29, 2021

ebyhr commented Sep 30, 2021

findepi commented Oct 25, 2021

findepi commented Nov 9, 2021

skrzypo987 commented Nov 10, 2021

findepi commented Dec 6, 2021

findepi commented Dec 8, 2021

findepi commented Dec 8, 2021

findepi commented Dec 8, 2021

findepi commented Dec 8, 2021

skrzypo987 commented Dec 10, 2021

kokosing commented Dec 10, 2021

homar commented Dec 14, 2021

ebyhr commented Jan 1, 2022

sopel39 commented Jun 1, 2022