The pipelines.exit-on-error works inconsistently

[hariso]

Bug description

With the pipelines.exit-on-error specified via command line, Conduit doesn't always exit. Roughly, once in 3-4 times it stops. It's interesting that when used in GoLand, it always works.

Steps to reproduce

1. Build Conduit (latest, main, v0.7.1, v0.6.2)
2. Run with ./conduit -pipelines.exit-on-error -pipelines.path ./test.yaml.

Expected: Conduit exits
Actual: Conduit sometimes exits

Test file:

version: "2.0"
pipelines:
    - id: file-pipeline
      status: running
      name: file-pipeline
      description: test pipline
      connectors:
        - id: source-connector
          type: source
          plugin: builtin:s3
          name: source-connector
          settings:
            path: ${SOURCE_FILE}
          processors: []
        - id: destination-connector
          type: destination
          plugin: builtin:s3
          name: destination-connector
          settings:
            path: ${DESTINATION_FILE}
          processors: []
      processors: []
      dead-letter-queue:
        plugin: ""
        settings: {}
        window-size: null
        window-nack-threshold: null

Version

v0.8.0-nightly.20230817, v0.7.1, v0.6.2