Sub Processors within processors like Foreach are not exposed in _simulate?verbose #19601
Labels
>bug
:Data Management/Ingest Node
Execution or management of Ingest Pipelines including GeoIP
discuss
from an offline discussion with @BigFunger around tracing nested processor behavior within a
foreach
processor.story of what works:
The purpose of the
verbose
flag in the simulate API is to expose the behavior of each processor that is executed in the pipeline. This is working correctly for top-level processors as well as nested processors in theon_failure
block.story of what breaks:
The foreach processor is currently the only processor that has nested processors executed outside of the
on_failure
block. These processors are not tracked in verbose simulate responses and make it difficult to debug and trace the evolution of the document.what should be done:
The Processor API should be updated to make it possible for processors to declare any nested processors that are executed so that the Simulate API can use such an API to keep track of all executed processors and return their results back to the user. Currently, this only affects the Foreach Processor, but further processors wrapping other processors are expected (e.g. a switch-statement-like processor).
The text was updated successfully, but these errors were encountered: