Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transforms mixed cluster "GET/start/stop old [cluster/batch] transforms" tests fail reproducibly #67945

Closed
gwbrown opened this issue Jan 25, 2021 · 5 comments
Labels
:ml/Transform Transform >test-failure Triaged test failures from CI

Comments

@gwbrown
Copy link
Contributor

gwbrown commented Jan 25, 2021

Build scan: https://gradle-enterprise.elastic.co/s/apxwwc63asjom

Repro line: ./gradlew clean ':x-pack:qa:rolling-upgrade:v7.12.0#oneThirdUpgradedTest' -Dtests.class="org.elasticsearch.upgrades.UpgradeClusterClientYamlTestSuiteIT" -Dtests.method="test {p0=mixed_cluster/80_transform_jobs_crud/Test GET, start, and stop old cluster batch transforms}" -Dtests.seed=562A6BADAD918E4D -Dtests.security.manager=true -Dtests.bwc=true -Dtests.locale=es-MX -Dtests.timezone=W-SU -Druntime.java=11 -Dtests.rest.suite=mixed_cluster

Reproduces locally?: Yes

Applicable branches: Observed on master-based PR branches, typically (always?) during BWC tests against 7.x (7.12.0 at time of writing).

Failure history: build-stats, these failures appear to have started on either Jan. 18 or Jan. 21, there are some similar-but-not-quite-the-same failures on the 18th, the exact error message first appears on the 21st.

There appear to be some similar failures for the continuous transforms version of this test as well, see this build scan. I haven't put much time into investigating that failure as my guess is that the root cause is the same.

Failure excerpt:

java.lang.AssertionError: Failure at [mixed_cluster/80_transform_jobs_crud:316]: expected [2xx] status code but api [data_frame_transform_deprecated.update_transform] returned [500 Internal Server Error] [---	
error:	
  root_cause:	
  - type: "transport_serialization_exception"	
    reason: "Failed to deserialize response from handler [org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler/org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler/org.elasticsearch.action.ActionListenerResponseHandler@77561550/org.elasticsearch.action.ActionListener$3@467557db]"	
    stack_trace: "org.elasticsearch.transport.TransportSerializationException: Failed\	
      \ to deserialize response from handler [org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler/org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler/org.elasticsearch.action.ActionListenerResponseHandler@77561550/org.elasticsearch.action.ActionListener$3@467557db]\n\	
      \tat org.elasticsearch.transport.InboundHandler.handleResponse(InboundHandler.java:278)\n\	
      \tat org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:139)\n\	
      \tat org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:95)\n\	
      \tat org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:686)\n\	
      \tat org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142)\n\	
      \tat org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117)\n\	
      \tat org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82)\n\	
      \tat org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:74)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)\n\	
      \tat io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)\n\	
      \tat io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1518)\n\tat io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1267)\n\	
      \tat io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1314)\n\tat io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:501)\n\	
      \tat io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:440)\n\	
      \tat io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)\n\	
      \tat io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)\n\	
      \tat io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)\n\	
      \tat io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)\n\	
      \tat io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)\n\	
      \tat io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615)\n\	
      \tat io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578)\n\	
      \tat io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)\n\tat io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)\n\	
      \tat io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)\n\	
      \tat java.base/java.lang.Thread.run(Thread.java:834)\nCaused by: java.lang.IllegalStateException:\	
      \ unexpected byte [0x6c]\n\tat org.elasticsearch.common.io.stream.StreamInput.readBoolean(StreamInput.java:588)\n\	
      \tat org.elasticsearch.common.io.stream.StreamInput.readBoolean(StreamInput.java:578)\n\	
      \tat org.elasticsearch.common.io.stream.StreamInput.readOptionalString(StreamInput.java:368)\n\	
      \tat org.elasticsearch.xpack.core.transform.transforms.DestConfig.<init>(DestConfig.java:54)\n\	
      \tat org.elasticsearch.xpack.core.transform.transforms.TransformConfig.<init>(TransformConfig.java:203)\n\	
      \tat org.elasticsearch.xpack.core.transform.action.UpdateTransformAction$Response.<init>(UpdateTransformAction.java:185)\n\	
      \tat org.elasticsearch.xpack.core.transform.action.UpdateTransformAction$Response.fromStreamWithBWC(UpdateTransformAction.java:190)\n\	
      \tat org.elasticsearch.action.ActionListenerResponseHandler.read(ActionListenerResponseHandler.java:69)\n\	
      \tat org.elasticsearch.action.ActionListenerResponseHandler.read(ActionListenerResponseHandler.java:36)\n\	
      \tat org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1167)\n\	
      \tat org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1154)\n\	
      \tat org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1167)\n\	
      \tat org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1154)\n\	
      \tat org.elasticsearch.transport.InboundHandler.handleResponse(InboundHandler.java:275)\n\	
      \t... 35 more\n"	
  type: "transport_serialization_exception"	
  reason: "Failed to deserialize response from handler [org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler/org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler/org.elasticsearch.action.ActionListenerResponseHandler@77561550/org.elasticsearch.action.ActionListener$3@467557db]"	
  caused_by:	
    type: "illegal_state_exception"	
    reason: "unexpected byte [0x6c]"	
    stack_trace: "java.lang.IllegalStateException: unexpected byte [0x6c]\n\tat org.elasticsearch.common.io.stream.StreamInput.readBoolean(StreamInput.java:588)\n\	
      \tat org.elasticsearch.common.io.stream.StreamInput.readBoolean(StreamInput.java:578)\n\	
      \tat org.elasticsearch.common.io.stream.StreamInput.readOptionalString(StreamInput.java:368)\n\	
      \tat org.elasticsearch.xpack.core.transform.transforms.DestConfig.<init>(DestConfig.java:54)\n\	
      \tat org.elasticsearch.xpack.core.transform.transforms.TransformConfig.<init>(TransformConfig.java:203)\n\	
      \tat org.elasticsearch.xpack.core.transform.action.UpdateTransformAction$Response.<init>(UpdateTransformAction.java:185)\n\	
      \tat org.elasticsearch.xpack.core.transform.action.UpdateTransformAction$Response.fromStreamWithBWC(UpdateTransformAction.java:190)\n\	
      \tat org.elasticsearch.action.ActionListenerResponseHandler.read(ActionListenerResponseHandler.java:69)\n\	
      \tat org.elasticsearch.action.ActionListenerResponseHandler.read(ActionListenerResponseHandler.java:36)\n\	
      \tat org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1167)\n\	
      \tat org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1154)\n\	
      \tat org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1167)\n\	
      \tat org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1154)\n\	
      \tat org.elasticsearch.transport.InboundHandler.handleResponse(InboundHandler.java:275)\n\	
      \tat org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:139)\n\	
      \tat org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:95)\n\	
      \tat org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:686)\n\	
      \tat org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142)\n\	
      \tat org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117)\n\	
      \tat org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82)\n\	
      \tat org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:74)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)\n\	
      \tat io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)\n\	
      \tat io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1518)\n\tat io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1267)\n\	
      \tat io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1314)\n\tat io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:501)\n\	
      \tat io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:440)\n\	
      \tat io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)\n\	
      \tat io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)\n\	
      \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)\n\	
      \tat io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)\n\	
      \tat io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)\n\	
      \tat io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)\n\	
      \tat io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615)\n\	
      \tat io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578)\n\	
      \tat io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)\n\tat io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)\n\	
      \tat io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)\n\	
      \tat java.base/java.lang.Thread.run(Thread.java:834)\n"	
  stack_trace: "org.elasticsearch.transport.TransportSerializationException: Failed\	
    \ to deserialize response from handler [org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler/org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler/org.elasticsearch.action.ActionListenerResponseHandler@77561550/org.elasticsearch.action.ActionListener$3@467557db]\n\	
    \tat org.elasticsearch.transport.InboundHandler.handleResponse(InboundHandler.java:278)\n\	
    \tat org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:139)\n\	
    \tat org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:95)\n\	
    \tat org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:686)\n\	
    \tat org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142)\n\	
    \tat org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117)\n\	
    \tat org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82)\n\	
    \tat org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:74)\n\	
    \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)\n\	
    \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)\n\	
    \tat io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)\n\	
    \tat io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271)\n\	
    \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)\n\	
    \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)\n\	
    \tat io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)\n\	
    \tat io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1518)\n\tat io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1267)\n\	
    \tat io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1314)\n\tat io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:501)\n\	
    \tat io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:440)\n\	
    \tat io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)\n\	
    \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)\n\	
    \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)\n\	
    \tat io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)\n\	
    \tat io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)\n\	
    \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)\n\	
    \tat io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)\n\	
    \tat io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)\n\	
    \tat io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)\n\	
    \tat io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)\n\	
    \tat io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615)\n\	
    \tat io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578)\n\	
    \tat io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)\n\tat io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)\n\	
    \tat io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)\n\	
    \tat java.base/java.lang.Thread.run(Thread.java:834)\nCaused by: java.lang.IllegalStateException:\	
    \ unexpected byte [0x6c]\n\tat org.elasticsearch.common.io.stream.StreamInput.readBoolean(StreamInput.java:588)\n\	
    \tat org.elasticsearch.common.io.stream.StreamInput.readBoolean(StreamInput.java:578)\n\	
    \tat org.elasticsearch.common.io.stream.StreamInput.readOptionalString(StreamInput.java:368)\n\	
    \tat org.elasticsearch.xpack.core.transform.transforms.DestConfig.<init>(DestConfig.java:54)\n\	
    \tat org.elasticsearch.xpack.core.transform.transforms.TransformConfig.<init>(TransformConfig.java:203)\n\	
    \tat org.elasticsearch.xpack.core.transform.action.UpdateTransformAction$Response.<init>(UpdateTransformAction.java:185)\n\	
    \tat org.elasticsearch.xpack.core.transform.action.UpdateTransformAction$Response.fromStreamWithBWC(UpdateTransformAction.java:190)\n\	
    \tat org.elasticsearch.action.ActionListenerResponseHandler.read(ActionListenerResponseHandler.java:69)\n\	
    \tat org.elasticsearch.action.ActionListenerResponseHandler.read(ActionListenerResponseHandler.java:36)\n\	
    \tat org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1167)\n\	
    \tat org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1154)\n\	
    \tat org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1167)\n\	
    \tat org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1154)\n\	
    \tat org.elasticsearch.transport.InboundHandler.handleResponse(InboundHandler.java:275)\n\	
    \t... 35 more\n"
@gwbrown gwbrown added >test-failure Triaged test failures from CI :ml/Transform Transform labels Jan 25, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml/Transform)

@gwbrown gwbrown changed the title Transforms mixed cluster "GET/start/stop old [cluster/batch] transforms" tests fails reproducibly Transforms mixed cluster "GET/start/stop old [cluster/batch] transforms" tests fail reproducibly Jan 25, 2021
@przemekwitek przemekwitek self-assigned this Jan 26, 2021
@przemekwitek
Copy link
Contributor

przemekwitek commented Jan 26, 2021

This bug only occurs on pull-request-bwc branch which makes me wonder whether:

  1. CI does not run this test for some reason and this is why the test does not fail on "regular" CI
  2. The issue is more related to the changes in the PR itself rather than the test which fails (it is known that serialization does not always fail at the place where the bug is)
  3. Maybe the PR was synced in the middle of latest transform-related changes in master/7.x (full sequence is: [Transform] Add support for search-time runtime fields. #67643, [7.x] [Transform] Add support for search-time runtime fields. (#67643) #67821, [Transform] disable bwc for backporting search runtime fields support #67822, [Transform] finish backport: adapt versions to 7.12 #67826)
    ?

@gwbrown: Do you think one of the above could take place here?

@gwbrown
Copy link
Contributor Author

gwbrown commented Jan 26, 2021

1 or 3 are possible, though I did also check on latest master (and again just before I write this), and the repro line fails against that, though with a different error. Additionally, if I run the whole transforms_jobs_crud suite with the same seed, the same two tests fail.

I don't think it's 2, because just checking 3 PRs this has hit, there's one that adjusts some searchable snapshots test code (#67917), one that adjusts how timestamps are printed (#67893), and one that makes changes to snapshots (#63513), none of which should impact serialization of Transforms.

If you believe this has been addressed and this repro line produces local failures for some reason which has already been addressed, feel free to close this issue and we can reopen it if/when it happens again.

@przemekwitek
Copy link
Contributor

If you believe this has been addressed and this repro line produces local failures for some reason which has already been addressed, feel free to close this issue and we can reopen it if/when it happens again.

The last occurrence of this issue is from 2 days ago. I'll wait a day or two, look at build-stats and then close this issue if no new occurrences show up.

@przemekwitek
Copy link
Contributor

The last occurrence of this issue is from 2 days ago. I'll wait a day or two, look at build-stats and then close this issue if no new occurrences show up.

I confirm that there were no new occurrences in the last days.
Closing the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:ml/Transform Transform >test-failure Triaged test failures from CI
Projects
None yet
Development

No branches or pull requests

3 participants