ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #125170

cockroach-teamcity · 2024-06-06T01:33:09Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 3fd77b601d4ccab0f854fef82f9a27b9b3fe303b:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m52s)

Stack:

goroutine 5210754 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality3063082464
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/cdc _{This test on roachdash | Improve this report!

Jira issue: CRDB-39284}

The text was updated successfully, but these errors were encountered:

cockroach-teamcity · 2024-06-07T14:43:38Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 7c23978da2866e5fec4ec99b436ca5baa3e4bfd3:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 7357772 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality1926158649
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-07T17:49:18Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ e2ddbb469ff4b38f1b38210514eed802073779ed:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 5761745 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality3856072465
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-10T21:55:28Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 9e2e4fbab24c2a75f4c0d0b3a40c3e15e521dd1e:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 5183220 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality3928356412
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-12T00:48:10Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 00d41392f1deb1d87e5b9e541f660ec8d04ccbb7:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 7178784 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality2910626069
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-13T00:59:17Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ aa0437d20146abd2d9bc2390f34fe3da5ec6bfec:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m50s)

Stack:

goroutine 6649591 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality1660643343
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-13T22:26:44Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ e1d779792d1126c2f1937e7072f2d9d3776a3308:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m52s)

Stack:

goroutine 7274821 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality1560248042
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-13T22:43:50Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ b1bf99cf6cd6f4ba8e5ed0f87009f0c746b6a8c1:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 5395776 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality770940385
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-14T18:57:31Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ e6d22a8ffb875d579513fd23fff955ccc495e95f:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 5688602 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality350517059
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-17T15:32:28Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 5e92b7997363176d183964703a9ec00ea46188f2:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 5776871 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality994583367
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-17T15:52:31Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 5e92b7997363176d183964703a9ec00ea46188f2:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 9031436 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality2305746643
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-18T00:24:04Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ d88af9d8d14c906b18a4247ddbdba5f56cba71c9:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m51s)

Stack:

goroutine 5513201 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality2450728679
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-18T00:45:29Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ d88af9d8d14c906b18a4247ddbdba5f56cba71c9:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 8220853 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality3170100749
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-18T01:07:07Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ d88af9d8d14c906b18a4247ddbdba5f56cba71c9:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 8984563 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality2376973113
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-18T18:13:12Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 82a79b04a272aadc0eeb36a31f1fb5b17e8326b1:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m55s)

Stack:

goroutine 6533567 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality895499966
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-19T19:11:25Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ dc1c44f2f2d12fe4356139c775aaeff4cff9a4f6:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 5546559 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality1346867912
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-20T00:46:00Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ cef0033ce019cc2d37c856bb6e4fe356a0db06cd:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 5673822 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality589842435
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-20T01:05:14Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ cef0033ce019cc2d37c856bb6e4fe356a0db06cd:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 8822268 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality872147895
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-20T01:25:36Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ cef0033ce019cc2d37c856bb6e4fe356a0db06cd:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 9268503 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality411748073
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-21T12:34:08Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ ad609dd3657ad4975ce47a71bd65f3eeb9cd8f92:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 5773194 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality1057920893
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-21T14:40:52Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 7a22234cc9345bf3ffeae2f638c7f82369b09aea:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 4988122 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality100901059
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-21T15:01:36Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 7a22234cc9345bf3ffeae2f638c7f82369b09aea:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 8734679 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality4214304170
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-21T23:31:57Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 4a708c864424fd0163738869ab2602a958ad2c09:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 4529946 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality4171718026
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-06-22T05:16:10Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 8a97a5edd98336e2dd04ef12f08628fba84b17dd:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 8881517 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality3544786777
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.

Help

See also: How To Investigate a Go Test Failure (internal)

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-08-27T21:16:22Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 4d78390e719359bfabb3046d2b1807bb0f09d84a:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 6115171 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality3326705723
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-08-27 20:42:27: starting the test cluster took 5.561360236s
    changefeed_dist_test.go:410: 2024-08-27 20:42:27: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-08-27 20:42:28: creating and inserting rows into table took 129.939198ms
    changefeed_dist_test.go:418: 2024-08-27 20:42:28: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-08-27 20:42:28: spitting the table took 849.781085ms
    changefeed_dist_test.go:426: 2024-08-27 20:42:28: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-08-28T12:58:55Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ b2f2e2042942c40f0a4c86be9a8f61ff0a6db6fc:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m55s)

Stack:

goroutine 5502672 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality2615577509
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-08-28 12:23:02: starting the test cluster took 4.806049398s
    changefeed_dist_test.go:410: 2024-08-28 12:23:02: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-08-28 12:23:02: creating and inserting rows into table took 54.854388ms
    changefeed_dist_test.go:418: 2024-08-28 12:23:02: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-08-28 12:23:03: spitting the table took 743.061476ms
    changefeed_dist_test.go:426: 2024-08-28 12:23:03: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-08-28T13:21:31Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ b2f2e2042942c40f0a4c86be9a8f61ff0a6db6fc:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m55s)

Stack:

goroutine 8349274 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality3471742079
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-08-28 13:06:29: starting the test cluster took 3.550707551s
    changefeed_dist_test.go:410: 2024-08-28 13:06:29: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-08-28 13:06:29: creating and inserting rows into table took 27.097679ms
    changefeed_dist_test.go:418: 2024-08-28 13:06:29: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-08-28 13:06:29: spitting the table took 467.924524ms
    changefeed_dist_test.go:426: 2024-08-28 13:06:29: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-08-28T17:08:29Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ b594a49140232f2eb94073c954dc7b0cc6470478:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m52s)

Stack:

goroutine 3156244 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality2850392982
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-08-28 16:18:01: starting the test cluster took 6.226585917s
    changefeed_dist_test.go:410: 2024-08-28 16:18:01: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-08-28 16:18:01: creating and inserting rows into table took 63.76474ms
    changefeed_dist_test.go:418: 2024-08-28 16:18:01: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-08-28 16:18:02: spitting the table took 902.355719ms
    changefeed_dist_test.go:426: 2024-08-28 16:18:02: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-08-29T06:35:12Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 74429f0c2f2e54bd1aecd5d59776887d1755be8a:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 4413117 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality3325444329
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-08-29 06:05:43: starting the test cluster took 4.884709849s
    changefeed_dist_test.go:410: 2024-08-29 06:05:43: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-08-29 06:05:44: creating and inserting rows into table took 45.548441ms
    changefeed_dist_test.go:418: 2024-08-29 06:05:44: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-08-29 06:05:44: spitting the table took 780.090273ms
    changefeed_dist_test.go:426: 2024-08-29 06:05:44: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-08-29T16:00:41Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 67b61e597f9feb50a9253ae38e7fc9b53406938c:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m52s)

Stack:

goroutine 6169028 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality3992817546
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-08-29 15:33:36: starting the test cluster took 6.865700499s
    changefeed_dist_test.go:410: 2024-08-29 15:33:36: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-08-29 15:33:37: creating and inserting rows into table took 176.349476ms
    changefeed_dist_test.go:418: 2024-08-29 15:33:37: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-08-29 15:33:38: spitting the table took 956.688083ms
    changefeed_dist_test.go:426: 2024-08-29 15:33:38: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-08-29T18:06:52Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 65fdb8a90e7f2215bec5d3661056fcb3fa87084a:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 2869008 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality2944314323
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-08-29 17:30:37: starting the test cluster took 8.025893001s
    changefeed_dist_test.go:410: 2024-08-29 17:30:37: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-08-29 17:30:37: creating and inserting rows into table took 137.335434ms
    changefeed_dist_test.go:418: 2024-08-29 17:30:37: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-08-29 17:30:38: spitting the table took 1.245607538s
    changefeed_dist_test.go:426: 2024-08-29 17:30:38: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-08-29T23:03:39Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 4756b021edfdd477427f4ec34bf83f837f26a855:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m52s)

Stack:

goroutine 5310690 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality887410161
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-08-29 22:41:12: starting the test cluster took 8.165603974s
    changefeed_dist_test.go:410: 2024-08-29 22:41:12: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-08-29 22:41:12: creating and inserting rows into table took 181.886265ms
    changefeed_dist_test.go:418: 2024-08-29 22:41:12: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-08-29 22:41:13: spitting the table took 1.156396115s
    changefeed_dist_test.go:426: 2024-08-29 22:41:13: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-08-29T23:26:42Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 4756b021edfdd477427f4ec34bf83f837f26a855:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 8220049 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality1922960011
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-08-29 23:11:40: starting the test cluster took 3.595440923s
    changefeed_dist_test.go:410: 2024-08-29 23:11:40: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-08-29 23:11:40: creating and inserting rows into table took 28.88903ms
    changefeed_dist_test.go:418: 2024-08-29 23:11:40: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-08-29 23:11:41: spitting the table took 480.238165ms
    changefeed_dist_test.go:426: 2024-08-29 23:11:41: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-08-29T23:49:28Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 4756b021edfdd477427f4ec34bf83f837f26a855:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 8172482 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality3843837540
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-08-29 23:34:27: starting the test cluster took 3.606354187s
    changefeed_dist_test.go:410: 2024-08-29 23:34:27: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-08-29 23:34:27: creating and inserting rows into table took 32.853678ms
    changefeed_dist_test.go:418: 2024-08-29 23:34:27: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-08-29 23:34:28: spitting the table took 474.280797ms
    changefeed_dist_test.go:426: 2024-08-29 23:34:28: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-08-30T18:50:49Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ e1ec4041a14be9d885e5d1cd3b504ac814c6bbc7:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 3831751 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality3542786732
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-08-30 18:16:36: starting the test cluster took 6.255297771s
    changefeed_dist_test.go:410: 2024-08-30 18:16:36: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-08-30 18:16:36: creating and inserting rows into table took 64.721151ms
    changefeed_dist_test.go:418: 2024-08-30 18:16:36: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-08-30 18:16:37: spitting the table took 1.072074914s
    changefeed_dist_test.go:426: 2024-08-30 18:16:37: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-08-31T05:06:20Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 8551145a0c99c4c95a28ec470e699d0c20ca97ab:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m52s)

Stack:

goroutine 5053829 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality3203829493
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-08-31 04:30:09: starting the test cluster took 5.535765609s
    changefeed_dist_test.go:410: 2024-08-31 04:30:09: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-08-31 04:30:09: creating and inserting rows into table took 83.56765ms
    changefeed_dist_test.go:418: 2024-08-31 04:30:09: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-08-31 04:30:10: spitting the table took 780.555227ms
    changefeed_dist_test.go:426: 2024-08-31 04:30:10: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-09-03T07:04:20Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 6318706297b37bcec52dd7524661d66b2487a4ab:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 5123060 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality2197303465
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-09-03 06:27:37: starting the test cluster took 5.999863045s
    changefeed_dist_test.go:410: 2024-09-03 06:27:38: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-09-03 06:27:38: creating and inserting rows into table took 44.893717ms
    changefeed_dist_test.go:418: 2024-09-03 06:27:38: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-09-03 06:27:38: spitting the table took 844.027192ms
    changefeed_dist_test.go:426: 2024-09-03 06:27:38: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #129994 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc C-test-failure O-robot T-kv X-duplicate branch-release-24.2.1-rc]
ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-cdc A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-09-04T06:58:10Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ ae386bd58eb341f2c3e8f95fc44ecbbac62cf6c4:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m53s)

Stack:

goroutine 4518811 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality1240962743
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-09-04 06:29:30: starting the test cluster took 6.499019849s
    changefeed_dist_test.go:410: 2024-09-04 06:29:30: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-09-04 06:29:31: creating and inserting rows into table took 91.054363ms
    changefeed_dist_test.go:418: 2024-09-04 06:29:31: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-09-04 06:29:31: spitting the table took 854.143776ms
    changefeed_dist_test.go:426: 2024-09-04 06:29:31: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #129994 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [C-test-failure O-robot T-kv X-duplicate branch-release-24.2.1-rc]
ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-09-04T22:52:28Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ 268e3b368f658f70633540b8e122f7538a805023:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m54s)

Stack:

goroutine 5093988 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality2673000285
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-09-04 22:33:13: starting the test cluster took 6.314545897s
    changefeed_dist_test.go:410: 2024-09-04 22:33:13: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-09-04 22:33:13: creating and inserting rows into table took 49.980881ms
    changefeed_dist_test.go:418: 2024-09-04 22:33:13: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-09-04 22:33:14: spitting the table took 880.437662ms
    changefeed_dist_test.go:426: 2024-09-04 22:33:14: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #129994 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [C-test-failure O-robot T-kv X-duplicate branch-release-24.2.1-rc]
ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

cockroach-teamcity · 2024-09-05T17:38:44Z

ccl/changefeedccl.TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed with artifacts on master @ d3e15d723ea8a7bd0c7e9c9600ff25df08525287:

Fatal error:

panic: test timed out after 14m57s
running tests:
	TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality (14m50s)

Stack:

goroutine 6473720 [running]:
testing.(*M).startAlarm.func1()
	GOROOT/src/testing/testing.go:2366 +0x30c
created by time.goFunc
	GOROOT/src/time/sleep.go:177 +0x38

Log preceding fatal error

=== RUN   TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality
    test_log_scope.go:170: test logs captured to: /artifacts/tmp/_tmp/f236cfce7e32f4b492de4b4f1cd80c96/logTestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality257267956
    test_log_scope.go:81: use -show-logs to present logs inline
    test_server_shim.go:157: automatically injected an external process virtual cluster under test; see comment at top of test_server_shim.go for details.
    changefeed_dist_test.go:398: 2024-09-05 17:14:36: starting the test cluster took 4.174641426s
    changefeed_dist_test.go:410: 2024-09-05 17:14:36: creating and inserting rows into table
    changefeed_dist_test.go:416: 2024-09-05 17:14:37: creating and inserting rows into table took 70.182361ms
    changefeed_dist_test.go:418: 2024-09-05 17:14:37: splitting table into single-key ranges
    changefeed_dist_test.go:423: 2024-09-05 17:14:37: spitting the table took 670.775041ms
    changefeed_dist_test.go:426: 2024-09-05 17:14:37: relocating ranges in exponential distribution

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #129994 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [C-test-failure O-robot T-kv X-duplicate branch-release-24.2.1-rc]
ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #127027 ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed [A-multitenancy C-test-failure O-robot P-2 T-kv X-duplicate branch-release-24.2]

_{This test on roachdash | Improve this report!}

130197: kvserver: wire up replica_rac range controller factory r=sumeerbhola a=kvoli RangeControllerFactory` is used to create new `RangeController`s when a replica becomes the raft leader. Add the missing required fields in `RangeControllerFactory` and wire up the factory to sit on the `Store`. The `RangeControllerFactory` is one per-store, with callers providing range specific information when asking for a new `RangeController`, and the factory retaining one per-node or per-store controller dependencies. Resolves: #130185 Release note: None 130242: changefeedccl: deflake TestChangefeedWithSimpleDistributionStrategy r=iskettaneh a=iskettaneh This change: #125117 removed giving 1M upfront tokens to new tenants. This seems that have cause some throttling in this test. This commit re-adds the 1M upfront tokens for the affected tests. Fixes: #125170 Epic: None Release note: None Co-authored-by: Austen McClernon <[email protected]> Co-authored-by: Ibrahim Kettaneh <[email protected]>

blathers-crl · 2024-09-06T18:38:04Z

Based on the specified backports for linked PR #130242, I applied the following new label(s) to this issue: branch-release-24.2. Please adjust the labels as needed to match the branches actually affected by this issue, including adding any known older branches.

_{🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.}

This change: #125117 removed giving 1M upfront tokens to new tenants. This seems that have cause some throttling in this test. This commit re-adds the 1M upfront tokens for this test. Fixes: #125170 Epic: None Release note: None

blathers-crl bot added the A-cdc Change Data Capture label Jun 6, 2024

exalate-issue-sync bot assigned wenyihu6 Jun 12, 2024

github-project-automation bot added this to KV Aug 28, 2024

github-project-automation bot moved this to Incoming in KV Aug 28, 2024

cockroach-teamcity mentioned this issue Sep 2, 2024

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #129994

Closed

andyyang890 mentioned this issue Sep 3, 2024

ccl/changefeedccl: TestChangefeedWithNoDistributionStrategyAndConstrainedLocality failed #130004

Closed

iskettaneh mentioned this issue Sep 6, 2024

changefeedccl: deflake TestChangefeedWithSimpleDistributionStrategy #130242

Merged

craig bot closed this as completed in 9bc754d Sep 6, 2024

blathers-crl bot added the branch-release-24.2 Used to mark GA and release blockers, technical advisories, and bugs for 24.2 label Sep 6, 2024

blathers-crl bot mentioned this issue Sep 6, 2024

release-24.2: changefeedccl: deflake TestChangefeedWithSimpleDistributionStrategy #130261

Merged

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #125170

ccl/changefeedccl: TestChangefeedWithSimpleDistributionStrategyAndConstrainedLocality failed #125170

Comments

cockroach-teamcity commented Jun 6, 2024 • edited by cockroach-jira-scripts Loading

cockroach-teamcity commented Jun 7, 2024

cockroach-teamcity commented Jun 7, 2024

cockroach-teamcity commented Jun 10, 2024

cockroach-teamcity commented Jun 12, 2024

cockroach-teamcity commented Jun 13, 2024

cockroach-teamcity commented Jun 13, 2024

cockroach-teamcity commented Jun 13, 2024

cockroach-teamcity commented Jun 14, 2024

cockroach-teamcity commented Jun 17, 2024

cockroach-teamcity commented Jun 17, 2024

cockroach-teamcity commented Jun 18, 2024

cockroach-teamcity commented Jun 18, 2024

cockroach-teamcity commented Jun 18, 2024

cockroach-teamcity commented Jun 18, 2024

cockroach-teamcity commented Jun 19, 2024

cockroach-teamcity commented Jun 20, 2024

cockroach-teamcity commented Jun 20, 2024

cockroach-teamcity commented Jun 20, 2024

cockroach-teamcity commented Jun 21, 2024

cockroach-teamcity commented Jun 21, 2024

cockroach-teamcity commented Jun 21, 2024

cockroach-teamcity commented Jun 21, 2024

cockroach-teamcity commented Jun 22, 2024

cockroach-teamcity commented Aug 27, 2024

cockroach-teamcity commented Aug 28, 2024

cockroach-teamcity commented Aug 28, 2024

cockroach-teamcity commented Aug 28, 2024

cockroach-teamcity commented Aug 29, 2024

cockroach-teamcity commented Aug 29, 2024

cockroach-teamcity commented Aug 29, 2024

cockroach-teamcity commented Aug 29, 2024

cockroach-teamcity commented Aug 29, 2024

cockroach-teamcity commented Aug 29, 2024

cockroach-teamcity commented Aug 30, 2024

cockroach-teamcity commented Aug 31, 2024

cockroach-teamcity commented Sep 3, 2024

cockroach-teamcity commented Sep 4, 2024

cockroach-teamcity commented Sep 4, 2024

cockroach-teamcity commented Sep 5, 2024

blathers-crl bot commented Sep 6, 2024

cockroach-teamcity commented Jun 6, 2024 •

edited by cockroach-jira-scripts

Loading