Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roachtest: cdc/initial-scan failed #73294

Closed
cockroach-teamcity opened this issue Nov 30, 2021 · 10 comments · Fixed by #73395
Closed

roachtest: cdc/initial-scan failed #73294

cockroach-teamcity opened this issue Nov 30, 2021 · 10 comments · Fixed by #73395
Assignees
@miretskiy
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.

Comments

@cockroach-teamcity
Copy link
Member

roachtest.cdc/initial-scan failed with artifacts on master @ 7097a9015f1a09c7dee4fbdbcc6bde82121f657b:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/initial-scan/run_1
	cdc.go:1694,cdc.go:293,cdc.go:722,test_runner.go:779: max latency was more than allowed: 1m4.283099376s vs 1m0s
Help

See: roachtest README

See: How To Investigate (internal)

/cc @cockroachdb/cdc

This test on roachdash | Improve this report!
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Nov 30, 2021
@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/initial-scan failed with artifacts on master @ a80cfbee826f70988381a0a85c0fe7aba0115484:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/initial-scan/run_1
	cdc.go:1694,cdc.go:293,cdc.go:722,test_runner.go:779: max latency was more than allowed: 1m1.197819101s vs 1m0s
Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

@miretskiy miretskiy mentioned this issue Dec 2, 2021
Merged
@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/initial-scan failed with artifacts on master @ 260b7930e717c76bc421ae3f34e9a939fc896b50:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/initial-scan/run_1
	cdc.go:1694,cdc.go:293,cdc.go:722,test_runner.go:779: max latency was more than allowed: 1m4.118827725s vs 1m0s
Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/initial-scan failed with artifacts on master @ 506d129f5f187134c35e2f71860490e044fde989:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/initial-scan/run_1
	cdc.go:1691,cdc.go:293,cdc.go:722,test_runner.go:779: latency never dropped to acceptable steady level: 1m0s
Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/initial-scan failed with artifacts on master @ 39923c0b11d229b394fa5498ee58e455cae8ec99:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/initial-scan/run_1
	cdc.go:1694,cdc.go:293,cdc.go:722,test_runner.go:779: max latency was more than allowed: 1m0.739314251s vs 1m0s
Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/initial-scan failed with artifacts on master @ e89328d92398a3e2d6487179845a51e7f1caa435:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/initial-scan/run_1
	cdc.go:1694,cdc.go:293,cdc.go:722,test_runner.go:779: max latency was more than allowed: 1m5.665898319s vs 1m0s
Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/initial-scan failed with artifacts on master @ dd7fd4e5a371ce4437fce383b9674cba2e212fe6:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/initial-scan/run_1
	cdc.go:1691,cdc.go:293,cdc.go:722,test_runner.go:779: latency never dropped to acceptable steady level: 1m0s
Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/initial-scan failed with artifacts on master @ 8c1528fff5c132b971428bc7f18bf0ea5eb16799:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/initial-scan/run_1
	cdc.go:1717,cdc.go:298,cdc.go:727,test_runner.go:780: max latency was more than allowed: 1m4.640981442s vs 1m0s
Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/initial-scan failed with artifacts on master @ 01c0c739dd83b3e662d715404f2193d747f4fb9e:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/initial-scan/run_1
	cdc.go:1714,cdc.go:298,cdc.go:727,test_runner.go:780: latency never dropped to acceptable steady level: 1m0s
Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/initial-scan failed with artifacts on master @ 3471dc50db8406f3faa638940492dbe0cab53435:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/initial-scan/run_1
	cdc.go:1717,cdc.go:298,cdc.go:727,test_runner.go:780: max latency was more than allowed: 1m4.425615377s vs 1m0s
Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/initial-scan failed with artifacts on master @ 3401e4d902953f7684aebb819090f586c9acfec9:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/cdc/initial-scan/run_1
	cdc.go:1717,cdc.go:298,cdc.go:727,test_runner.go:780: max latency was more than allowed: 1m9.774675386s vs 1m0s
Help

See: roachtest README

See: How To Investigate (internal)

This test on roachdash | Improve this report!

craig bot pushed a commit that referenced this issue Jan 7, 2022
Merge #73395 #74552
72c74dc 
73395: changefeedccl: Explicitly set min_resolved_frequency. r=miretskiy a=miretskiy

Previously, the `resolved` was used to control the frequency of
of aggregators emitting checkpoint information to the frontier.
Now, this frequency is controlled via `min_checkpoint_frequency`.
Set checkpoint frequency to 10s, so that checkpoints are emitted
more frequently.  The default of 30s causes latency verifier
to fail at 1 minute since it's now very easy to simply miss
sending frontier updates (so latency can go up to almost 1 minute),
plus the closed timestamp setting of 10 second can exceed
required thresholds.

Fixes #73295
Fixes #73294
Fixes #72806

Release Notes: none

74552: kv: Allow nil when checking for empty lease. r=knz a=miretskiy

Treat nil lease as empty when checking for empty lease.
Recent changes in #66374
as well as in #74315 changed
how lease is stored as well as modified receiver type.  As a result,
attempts to print empty `EvictionToken{}` will result in a nil panic.

Release Notes: None

Co-authored-by: Yevgeniy Miretskiy <[email protected]>
@craig craig bot closed this as completed in 534345f Jan 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@miretskiy miretskiy

Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

changefeedccl: Explicitly set min_resolved_frequency. miretskiy/cockroach
2 participants
@cockroach-teamcity @miretskiy