Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add gatherer for sparrow-merge #827

Merged
merged 6 commits into from
Oct 23, 2023
Merged

Conversation

jordanrfrazier
Copy link
Collaborator

Adds the gatherer to the sparrow-merge crate. The gatherer is used to progress a watermark for several inputs and emit batches up to that watermark, rather than doing any actual merge stuff, but we'll want this eventually.

@cla-bot cla-bot bot added the cla-signed Set when all authors of a PR have signed our CLA label Oct 21, 2023
@github-actions github-actions bot added enhancement New feature or request sparrow labels Oct 21, 2023
crates/sparrow-batch/src/batch.rs Show resolved Hide resolved
crates/sparrow-batch/src/batch.rs Outdated Show resolved Hide resolved
crates/sparrow-batch/src/batch.rs Outdated Show resolved Hide resolved
crates/sparrow-merge/src/gather.rs Outdated Show resolved Hide resolved
crates/sparrow-merge/src/gather/gathered_batches.rs Outdated Show resolved Hide resolved
@jordanrfrazier jordanrfrazier added this pull request to the merge queue Oct 23, 2023
Merged via the queue into main with commit d0d5443 Oct 23, 2023
13 checks passed
@jordanrfrazier jordanrfrazier deleted the partitioned/add-gatherer branch October 23, 2023 17:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed Set when all authors of a PR have signed our CLA enhancement New feature or request sparrow
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants