Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

*: Add fast gzip compression library. #88632

Merged
merged 1 commit into from
Sep 27, 2022
Merged

Conversation

miretskiy
Copy link
Contributor

@miretskiy miretskiy commented Sep 23, 2022

Add https://github.com/klauspost/pgzip fast gzip
compression library.

Addresses #88585

Release notes: None

@miretskiy miretskiy requested review from a team as code owners September 23, 2022 22:13
@miretskiy miretskiy requested review from HonoreDB and removed request for a team September 23, 2022 22:13
@cockroach-teamcity
Copy link
Member

This change is Reviewable

Copy link
Contributor

@HonoreDB HonoreDB left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 6 of 6 files at r1, all commit messages.
Reviewable status: :shipit: complete! 0 of 0 LGTMs obtained (waiting on @miretskiy)

@miretskiy miretskiy force-pushed the 3pgzip branch 6 times, most recently from eb1d2e1 to fa1cf22 Compare September 26, 2022 20:14
@srosenberg srosenberg added the branch-release-22.2 Used to mark GA and release blockers, technical advisories, and bugs for 22.2 label Sep 26, 2022
Add https://github.com/klauspost/pgzip fast gzip
compression library.

Addresses cockroachdb#88585

Release notes: None
@miretskiy
Copy link
Contributor Author

bors r+

@craig
Copy link
Contributor

craig bot commented Sep 27, 2022

Build succeeded:

@craig craig bot merged commit c55586b into cockroachdb:master Sep 27, 2022
@srosenberg srosenberg added backport-22.2.x and removed branch-release-22.2 Used to mark GA and release blockers, technical advisories, and bugs for 22.2 labels Sep 27, 2022
@srosenberg
Copy link
Member

blathers backport 22.2

@blathers-crl
Copy link

blathers-crl bot commented Sep 27, 2022

Encountered an error creating backports. Some common things that can go wrong:

  1. The backport branch might have already existed.
  2. There was a merge conflict.
  3. The backport branch contained merge commits.

You might need to create your backport manually using the backport tool.


error creating merge commit from 688430b to blathers/backport-release-22.2-88632: POST https://api.github.com/repos/cockroachdb/cockroach/merges: 409 Merge conflict []

you may need to manually resolve merge conflicts with the backport tool.

Backport to branch 22.2 failed. See errors above.


🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is otan.

craig bot pushed a commit that referenced this pull request Oct 17, 2022
89524: backupccl: use klauspost gzip library r=benbardin a=benbardin

Expect some degree of speedup in manifest reading/writing, as in #88632.

Release note: None

89903: sql: make NOTHING and INDEX non-reserved keywords r=rafiss a=knz

Fixes #69420.

Release note (bug fix): It is now possible again to create tables,
views, columns, etc with the name `nothing` (e.g. `CREATE TABLE
nothing...`) without having to quote the name, like in
PostgreSQL. This bug was introduced in CockroachDB v2.0.

Release note (bug fix): It is now possible again to create tables,
views, columns, etc with the name `index` (e.g. `CREATE TABLE
index...`) without having to quote the name, like in
PostgreSQL. This bug was introduced in CockroachDB v1.0.


90000: workload/kv: fix --splits  r=ajwerner a=kvoli

Previously the `--splits` flag would generate splits assuming the kv
workload would always access keys in `[MinInt64, MaxInt64)`.
However, it was only true for the default uniform hash key generator.
While it was disabled for `--sequential` and `--zipfian` generates keys
in `[0, MaxInt64)`.

The previous `--split` flag also resulted in an integer overflow when
`--cycle-length` was greater than 0, only generating splits in
`[MinInt64, 0)`. This patch resolves the overflow issue.

This patch enables splits for `--sequential` and adjusts the `--splits`
logic to equally partition the keyspace, according to the access
distribution. The valid range for each is shown below.

uniform    `[MinInt64, MaxInt64)`
sequential `[0, --cycle-length)`
zipfian    `[0, MaxInt64)`

resolves #82906

Release note (cli change): In the kv workload enable `--splits` with the
`--sequential` flag and adjust splitting to uniformly partition the
keyspace.

Co-authored-by: Ben Bardin <[email protected]>
Co-authored-by: Raphael 'kena' Poss <[email protected]>
Co-authored-by: Austen McClernon <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants