Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Develop a ragel-based line protocol parser for use in filtering applications #16717

Closed
adrian-thurston opened this issue Feb 4, 2020 · 4 comments
Assignees

Comments

@adrian-thurston
Copy link
Contributor

At the all hands it was discussed with @GeorgeMac that a ragel-based line protocol parser for use in filtering applications would be welcome, with the goal of speeding up parsing and getting a better filtering throughput.

Some context here:

#16412

@adrian-thurston adrian-thurston self-assigned this Feb 4, 2020
@GeorgeMac
Copy link
Contributor

cc @stuartcarnie as using Ragel for this was his idea first :D

@adrian-thurston adrian-thurston changed the title Develop a ragel-based line protocol parser for use in non-cloud filtering applications Develop a ragel-based line protocol parser for use in filtering applications Feb 4, 2020
@adrian-thurston
Copy link
Contributor Author

@danielnelson
Copy link
Contributor

There is currently some work on a streaming interface for this parser in the influxdb-listener-refactor branch. We plan to use this to parse request bodies without loading the full request into memory. One potential issue with the parser I should mention is that it does not do any unicode validation.

@adrian-thurston
Copy link
Contributor Author

Closing, as this exists already in telegraf.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants