-
Notifications
You must be signed in to change notification settings - Fork 3.8k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
80247: changefeedccl: refactor to stop passing around untyped string maps r=[miretskiy] a=HonoreDB Why did I think this would be a quick win. This was slow and boring and might be too big a diff to do in one go. This PR makes the WITH options map into a typed object, and moves a lot of the parsing and validation code into methods on that object so that sinks, encoders, and so on can take small typed objects instead of the whole giant untyped map. The only time we still treat it as a giant map is input validation. I've kept the parsing of JSON WITH options in the individual sinks to go along with the 'quick and dirty add anything' vibe they have. There's still work to do here: the protos used to communicate state live outside of ccl, so we're still passing around the untyped map a lot. And some more logic that could be moved into options.go . But the diff is big enough already. Release note: None Closes #80105 83000: vendor: bump Pebble to c2c0273062ce r=nicktrav a=jbowens ``` c2c02730 db: fix SetOptions batch range{del,key} refresh logic 2aebabad sstable: remove obsolete linter ignore directive dc391ef8 docs: use local scale by default on nightly benchmarks page ef1ca573 compaction: elision-only compactions for tables with only range keys 4a952c0d db: document Batch as unsafe for concurrent access 9a8e4742 db: support SetOptions on iterators created through NewExternalIter f13de498 db: fix nil-pointer in external iterator range key iteration 65702e71 db: avoid allocation in newIters f185d7fa db: remove RangeKeysArena ae99f4f1 *: start reading range keys from sstables d72083df *: implement compaction/flushing of range keys a015e5a0 db: exclude empty batch range deletion, range key iterators 8b7a68b8 compaction: introduce multi level compaction mechanics 67f2653a *: pass keyspan.Spans by pointer not value 83b45b0a internal/keyspan: refactor InterleavingIter bounds checking c3053e0b internal/keyspan: manually inline {start,end}Bound in MergingIter 728722c5 internal/keyspan: refactor DefragmentingIter's invalid span checks a5d4e00e db: add BenchmarkIteratorSeekNoRangeKeys 96dc71db internal/keyspan: preallocate merging iter levels, items 86dd6fd5 internal/keyspan: replace calls to Span.Visible ``` Release note: none Co-authored-by: Aaron Zinger <[email protected]> Co-authored-by: Jackson Owens <[email protected]>
- Loading branch information
Showing
39 changed files
with
1,245 additions
and
634 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -1347,10 +1347,10 @@ def go_deps(): | |
patches = [ | ||
"@com_github_cockroachdb_cockroach//build/patches:com_github_cockroachdb_pebble.patch", | ||
], | ||
sha256 = "6fb7e9f191b1efde244b55dec4697e6128eb17186b3cc25b0eae2f196024004b", | ||
strip_prefix = "github.com/cockroachdb/[email protected]20220603185428-ad44a62e4d04", | ||
sha256 = "0a9c86f063e1e28409981a760e9167a8f24e47fcfbaa707d2eae291c3d3d01dc", | ||
strip_prefix = "github.com/cockroachdb/[email protected]20220616170629-c2c0273062ce", | ||
urls = [ | ||
"https://storage.googleapis.com/cockroach-godeps/gomod/github.com/cockroachdb/pebble/com_github_cockroachdb_pebble-v0.0.0-20220603185428-ad44a62e4d04.zip", | ||
"https://storage.googleapis.com/cockroach-godeps/gomod/github.com/cockroachdb/pebble/com_github_cockroachdb_pebble-v0.0.0-20220616170629-c2c0273062ce.zip", | ||
], | ||
) | ||
go_repository( | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.