-
Notifications
You must be signed in to change notification settings - Fork 15
Configurable GzipCompressingInputStream compression buffer size #5848
Conversation
Allow configuring the GZIP compression buffer size. Increase default compression buffer size to 64 KiB.
Generate changelog in
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
looks good, though I think we should fix the changelog
for (int i = 0; i < data.length; i++) { | ||
if (stream.read() != Byte.toUnsignedInt(data[i])) { | ||
for (byte datum : data) { | ||
if (stream.read() != Byte.toUnsignedInt(datum)) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
💯
changelog/@unreleased/pr-5848.v2.yml
Outdated
description: |- | ||
Configurable GzipCompressingInputStream compression buffer size | ||
|
||
**Goals (and why)**: | ||
`GzipCompressingInputStream` did not allow configuring compression buffer size, leading to suboptimal compression with default `DeflaterInputStream` buffer size of 512 bytes. | ||
|
||
**Implementation Description (bullets)**: | ||
Allow configuring the GZIP compression buffer size. Increase default compression buffer size to 64 KiB. | ||
|
||
**Testing (What was existing testing like? What have you done to improve it?)**: | ||
StreamCompressionTests | ||
|
||
**Concerns (what feedback would you like?)**: Is 64 KiB too large default? My sense is no, and that's the current default for LZ4 block size. | ||
|
||
**Where should we start reviewing?**: GzipCompressingInputStream | ||
|
||
**Priority (whenever / two weeks / yesterday)**: this week | ||
|
||
<!--- | ||
Please remember to: | ||
- Add any necessary release notes (including breaking changes) | ||
- Make sure the documentation is up to date for your change | ||
---> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
description: |- | |
Configurable GzipCompressingInputStream compression buffer size | |
**Goals (and why)**: | |
`GzipCompressingInputStream` did not allow configuring compression buffer size, leading to suboptimal compression with default `DeflaterInputStream` buffer size of 512 bytes. | |
**Implementation Description (bullets)**: | |
Allow configuring the GZIP compression buffer size. Increase default compression buffer size to 64 KiB. | |
**Testing (What was existing testing like? What have you done to improve it?)**: | |
StreamCompressionTests | |
**Concerns (what feedback would you like?)**: Is 64 KiB too large default? My sense is no, and that's the current default for LZ4 block size. | |
**Where should we start reviewing?**: GzipCompressingInputStream | |
**Priority (whenever / two weeks / yesterday)**: this week | |
<!--- | |
Please remember to: | |
- Add any necessary release notes (including breaking changes) | |
- Make sure the documentation is up to date for your change | |
---> | |
description: |- | |
Allow configuring the GZIP compression buffer size. Increase default compression buffer size to 64 KiB. |
probably an oversight
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yeah, we need to update PR template, created #5849 to add the ==COMMIT_MSG==
section
🏎️ race condition yeah this looks good 👍 |
Goals (and why):
GzipCompressingInputStream
did not allow configuring compression buffer size, leading to suboptimal compression with defaultDeflaterInputStream
buffer size of 512 bytes.Implementation Description (bullets):
Allow configuring the GZIP compression buffer size. Increase default compression buffer size to 64 KiB.
Testing (What was existing testing like? What have you done to improve it?):
StreamCompressionTests
Concerns (what feedback would you like?): Is 64 KiB too large default? My sense is no, and that's the current default for LZ4 block size.
Where should we start reviewing?: GzipCompressingInputStream
Priority (whenever / two weeks / yesterday): this week