HTTP Input

[edsiper]

support HTTP input, payload as JSON or MessagePack.

note: work in process.

[edsiper]

Work in process:

0bca1e0 lib: monkey: upgrade http stack
29abd99 in_http: fix static linking and start server for testing purposes
f600c1e lib: monkey: scheduler timeout improvement / updates on exception handling and general reports by Coverity tool
613720f in_http: handle HTTP server setup, custom C headers and config
bc2757a in_http: fix linking to http library
a2ee8dc Build: fix configuration override for in_http (monkey lib)
0144c08 in_http: add plugin skeleton files
7f564d2 in_http: merging HTTP server and working in plugin
3ab208c Merge branch 'master' into http
7fd3c10 mk_core: upgrade to newer version used in Monkey Server
3e731e9 in_http: prepare build system

[Globegitter]

@edsiper Does fluent-bit now support json input over http? Couldn't find anything in the docs.

[edsiper]

@Globegitter not yet

[felixzh2020]

@edsiper Do you have a plan to support json input over http? Work in process now?

[StevenACoffman]

Supporting in_http might be very useful for property-based testing purposes. If we could input and output both via HTTP, we could specify a configuration (like a filter) and some "For All" (∀) expectations or rules. This lets you generate input to find obscure bugs, then reduce to minimal failing input. In C, I believe theft is the most mature.

@felixzh2015 What is your use case for in_http?

[ashleyschuett]

Is there any progress with this? or is there a way I can assist with getting this feature in?

[faisal-khalique]

Will this be available anytime soon please? I checked the current version 1.1.2 still has http input set to No.

[mvlbarcelos]

Hi Fluentbit team,

Is the http input already available?

Best Regards,
Marcus Barcelos

[majoyz]

Is there still any plan on in_http?

[edsiper]

it's coming, first PoC:

• https://asciinema.org/a/375571

[agup006]

it's here! We get to close this one out

in_http is available in 1.7.0, note: the doc site had some issues and we expect the in_http documentation to be available by end of the week.

[DrackThor]

Can you give an update on the docs @agup006 ? Is the input ready to be used (in 1.7.x)?
Thanks in advance :)

[agup006]

Docs were published here https://docs.fluentbit.io/manual/pipeline/inputs/http @DrackThor

[DrackThor]

Docs were published here https://docs.fluentbit.io/manual/pipeline/inputs/http @DrackThor

sorry, my bad - thanks for the hint!

[agup006]

No apologies needed @DrackThor :) glad I could help - let us know your feedback

[popaconsta]

Does this plugin handle well many incoming requests (i.e. hundreds or even thousands of applications writing to the same endpoint where Fluent Bit is listening)? As fare as I am aware there is no way no configure the number or workers or anything like that. Thanks in advance to whoever can shed some light.