Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

StorageKafka: check dependencies recursively, add max_block setting #3396

Merged
merged 2 commits into from
Oct 22, 2018

Conversation

vavrusa
Copy link
Contributor

@vavrusa vavrusa commented Oct 16, 2018

Changes:

  • Check table dependencies recursively before starting streaming
  • Use actual number of created consumers when streaming
  • Add size limits hint to Kafka consumer stream
  • Configurable kafka_max_block_size per table

I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en

@vavrusa vavrusa force-pushed the master branch 5 times, most recently from 4492a10 to f3c6d37 Compare October 18, 2018 04:55
Changes:

* Check table dependencies recursively before starting streaming
* Use actual number of created consumers when streaming
* Add size limits hint to Kafka consumer stream
* Configurable `kafka_max_block_size` per table
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants