Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support New CloudWatch Logs Sequence Token Deprecation and Ingestion Limit Removal #526

Closed
PettitWesley opened this issue Jan 26, 2023 · 2 comments
Assignees

Comments

@PettitWesley
Copy link
Contributor

PettitWesley commented Jan 26, 2023

We are working on removing sequence token tracking which will enable higher throughput: fluent/fluent-bit#6741

We also need to update our load tests to test higher throughput: fluent/fluent-bit#6741 (comment)

When this is released, it means you can now use multi-workers with cloudwatch_logs output:

[OUTPUT]
    Name cloudwatch_logs
    Match   *
    region us-east-1
    log_group_name fluent-bit-cloudwatch
    log_stream_prefix from-fluent-bit-
    auto_create_group On
    workers 5

UPDATE: This is released: https://github.com/aws/aws-for-fluent-bit/releases/tag/v2.32.0

@matthewfala
Copy link
Contributor

@matthewfala
Copy link
Contributor

Here's the updated PR to master: fluent/fluent-bit#7973
And it's corresponding aws-for-fluent-bit release: #733

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants