Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ignore_missing parameter is missing on "remove" pipeline processor #23086

Closed
ccelson opened this issue Feb 9, 2017 · 2 comments · Fixed by #31693
Closed

ignore_missing parameter is missing on "remove" pipeline processor #23086

ccelson opened this issue Feb 9, 2017 · 2 comments · Fixed by #31693
Assignees
Labels
:Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >enhancement

Comments

@ccelson
Copy link

ccelson commented Feb 9, 2017

Elasticsearch version: 5.1

Plugins installed:

JVM version: 1.8.0_121-b13

OS version: Mac OS 10.10.5

Description of the problem including expected versus actual behavior:
"Remove" Pipeline processor does not all allow for the "ignore_missing" parameter.

Steps to reproduce:
1.

POST _ingest/pipeline/_simulate
{
  "pipeline": {
    "description": "remove specific fields",
    "processors": [
      {
        "remove": {
          "field": "to_remove",
          "ignore_missing": true
        }
      }
    ]
  },
  "docs": [
    {
      "field1": "field1"
    }
  ]
}

Results in

{
  "error": {
    "root_cause": [
      {
        "type": "parse_exception",
        "reason": "processor [remove] doesn't support one or more provided configuration parameters [ignore_missing]",
        "header": {
          "processor_type": "remove"
        }
      }
    ],
    "type": "parse_exception",
    "reason": "processor [remove] doesn't support one or more provided configuration parameters [ignore_missing]",
    "header": {
      "processor_type": "remove"
    }
  },
  "status": 400
}

I would expect the "ignore_missing" parameter to be available on the remove processor.

@ccelson ccelson changed the title ignore_missing parameter is missing on some pipeline processors ignore_missing parameter is missing on "remove" pipeline processors Feb 9, 2017
@ccelson ccelson changed the title ignore_missing parameter is missing on "remove" pipeline processors ignore_missing parameter is missing on "remove" pipeline processor Feb 9, 2017
@clintongormley clintongormley added :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >enhancement labels Feb 9, 2017
@talevy
Copy link
Contributor

talevy commented Feb 14, 2017

@ccelson thanks for the report! I will go ahead and add the ignore_missing flag. For the time being, maybe try ignore_failure[1]

@talevy talevy added :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP and removed :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP labels Mar 15, 2018
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra

original-brownbear added a commit to original-brownbear/elasticsearch that referenced this issue Jun 29, 2018
Added `ignore_missing` setting to the RemoveProcessor to fix elastic#23086
original-brownbear added a commit that referenced this issue Jul 9, 2018
Added `ignore_missing` setting to the RemoveProcessor to fix #23086
original-brownbear added a commit that referenced this issue Jul 9, 2018
Added `ignore_missing` setting to the RemoveProcessor to fix #23086
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >enhancement
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants