Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sub Processors within processors like Foreach are not exposed in _simulate?verbose #19601

Closed
talevy opened this issue Jul 26, 2016 · 1 comment
Labels
>bug :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP discuss

Comments

@talevy
Copy link
Contributor

talevy commented Jul 26, 2016

from an offline discussion with @BigFunger around tracing nested processor behavior within a foreach processor.

story of what works:
The purpose of the verbose flag in the simulate API is to expose the behavior of each processor that is executed in the pipeline. This is working correctly for top-level processors as well as nested processors in the on_failure block.

story of what breaks:
The foreach processor is currently the only processor that has nested processors executed outside of the on_failure block. These processors are not tracked in verbose simulate responses and make it difficult to debug and trace the evolution of the document.

what should be done:
The Processor API should be updated to make it possible for processors to declare any nested processors that are executed so that the Simulate API can use such an API to keep track of all executed processors and return their results back to the user. Currently, this only affects the Foreach Processor, but further processors wrapping other processors are expected (e.g. a switch-statement-like processor).

@talevy
Copy link
Contributor Author

talevy commented Mar 15, 2018

closing since it has not been needed for almost two years

@talevy talevy closed this as completed Mar 15, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>bug :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP discuss
Projects
None yet
Development

No branches or pull requests

1 participant