Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

logictest: revert incorrect test assertion update #121556

Merged
merged 1 commit into from
Apr 2, 2024

Conversation

rafiss
Copy link
Collaborator

@rafiss rafiss commented Apr 2, 2024

1fcff46 incorrectly updated the test expectations, likely because the --rewrite flag was used on an assertion that has the retry directive.

This commit undoes that change.

fixes #121351
Release note: None

1fcff46 incorrectly updated the test expectations, likely because the
--rewrite flag was used on an assertion that has the `retry` directive.

This commit undoes that change.

Release note: None
@rafiss rafiss added the backport-24.1.x Flags PRs that need to be backported to 24.1. label Apr 2, 2024
@rafiss rafiss requested review from yuzefovich and msbutler April 2, 2024 16:25
@cockroach-teamcity
Copy link
Member

This change is Reviewable

Copy link
Member

@yuzefovich yuzefovich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

Reviewed 1 of 1 files at r1, all commit messages.
Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @msbutler)

@rafiss
Copy link
Collaborator Author

rafiss commented Apr 2, 2024

bors r+

@craig
Copy link
Contributor

craig bot commented Apr 2, 2024

This PR was included in a batch that timed out, it will be automatically retried

@craig craig bot merged commit 40f28d3 into cockroachdb:master Apr 2, 2024
23 of 37 checks passed
@rafiss rafiss deleted the fix-system-zone-config-test branch April 3, 2024 02:09
michae2 added a commit to michae2/cockroach that referenced this pull request Sep 10, 2024
(Deja vu: this is cockroachdb#121556 all over again.)

103bd54 incorrectly updated the test expectations, likely because the
`--rewrite` flag was used on an assertion that has the retry directive.

This commit undoes that change.

Fixes: cockroachdb#130405

Release note: None
craig bot pushed a commit that referenced this pull request Sep 18, 2024
130453: logictest: revert incorrect test assertion update r=rafiss a=michae2

(Deja vu: this is #121556 all over again.)

103bd54 incorrectly updated the test expectations, likely because the `--rewrite` flag was used on an assertion that has the retry directive.

This commit undoes that change.

Fixes: #130405

Release note: None

130572: storage: GC range keys by unsetting identical suffixes r=jbowens a=jbowens

In CockroachDB's key encoding some keys have multiple logically equivalent but physically distinct encodings. Most notably, in CockroachDB versions 23.2 and earlier keys written to global tables encoded MVCC timestamps with a 'synthetic bit.' In #101938 CockroachDB stopped encoding and decoding this synthetic bit, transparently ignoring it.

In #129592 we observed the existence of a bug in the CockroachDB comparator when comparing two MVCC timestamp suffixes, specifically outside the context of a full MVCC key. The comparator failed to consider a timestamp with the synthetic bit and a timestamp without the synthetic bit as logically equivalent. There are limited instances where Pebble uses the comparator to compare "bare suffixes," and all instances are constrained to the implementation of range keys.

In #129592 it was observed that the comparator bug could prevent the garbage collection of MVCC delete range tombstones (the single use of range keys within CockroachDB). A cluster running 23.2 or earlier may write a MVCC delete range tombstone with a timestamp encoding the synthetic bit. If the cluster subsequently upgraded to 24.1 or later, the code path to clear range keys stopped understanding synthetic bits and wrote range key unset tombstones without the synthetic bit set. Due to the comparator bug, Pebble did not consider these timestamp suffixes equal and the unset was ineffective.

We initially attempted to fix this issue by fixing the comparator, but inadvertently introduced the possibility of replica divergence #130533 by changing the semantics of LSM state below raft.

This commit works around this comparator bug by adapting ClearMVCCRangeKey to write range key unsets using the verbatim suffix that was read from the storage engine. To avoid reverting #101938 and re-introducing knowledge of the synthetic bit, the MVCCRangeKey data structures are adapted to retain a copy of the encoded timestamp suffix when reading range keys from storage engine iterators. If later an attempt is made to clear the range key through ClearMVCCRangeKey, this encoded timestamp suffix is used instead of re-encoding the timestamp. Through avoiding the decoding/encoding roundtrip, ClearMVCCRangeKey ensures that the suffixes it writes are identical to the range keys that exist on disk, even if they encode a synthetic bit.

Release note (bug fix): Fixes a bug that could result in the inability to garbage collect a MVCC range tombstone within a global table.
Epic: none
Informs #129592.

130906: sql: deflake TestValidationWithProtectedTS r=rafiss a=rafiss

This test does not work if ranges get split, so we disable the split queue.

fixes #130715
Release note: None

Co-authored-by: Michael Erickson <[email protected]>
Co-authored-by: Jackson Owens <[email protected]>
Co-authored-by: Rafi Shamim <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport-24.1.x Flags PRs that need to be backported to 24.1.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

pkg/sql/logictest/tests/fakedist-disk/fakedist-disk_test: TestLogic_zone_config_system_tenant failed
3 participants