Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Configurable output format for date processor #61324

Merged
merged 2 commits into from
Aug 20, 2020

Conversation

danhermann
Copy link
Contributor

Adds an optional output_format setting to the date processor that controls the formatting of the date. Supports the same formats as the formats option and can be used to output times including microsecond or nanosecond components.

Resolves #42523.

@danhermann danhermann added >enhancement :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP v8.0.0 v7.10.0 labels Aug 19, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-features (:Core/Features/Ingest)

@elasticmachine elasticmachine added the Team:Data Management Meta label for data/management team label Aug 19, 2020
Copy link
Member

@dakrone dakrone left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@danhermann
Copy link
Contributor Author

Thanks @dakrone!

@danhermann
Copy link
Contributor Author

@elasticmachine run elasticsearch-ci/packaging-sample-unix

@danhermann danhermann merged commit af6c786 into elastic:master Aug 20, 2020
@danhermann danhermann deleted the 42523_configurable_date_format branch August 20, 2020 21:18
droberts195 added a commit to droberts195/elasticsearch that referenced this pull request Sep 7, 2020
Now that elastic#61324 is merged it is possible for the find_file_structure
endpoint to suggest using date_nanos fields for timestamps where
the timestamp format provides greater than millisecond accuracy.
droberts195 added a commit that referenced this pull request Sep 8, 2020
Now that #61324 is merged it is possible for the find_file_structure
endpoint to suggest using date_nanos fields for timestamps where
the timestamp format provides greater than millisecond accuracy.
droberts195 added a commit that referenced this pull request Sep 8, 2020
Now that #61324 is merged it is possible for the find_file_structure
endpoint to suggest using date_nanos fields for timestamps where
the timestamp format provides greater than millisecond accuracy.
@droberts195
Copy link
Contributor

@danhermann this is still backport pending. Would it be possible for you to backport it to 7.x soon? I have made a change in the file structure finder that uses this and would like that to go into 7.10.

@danhermann
Copy link
Contributor Author

@danhermann this is still backport pending. Would it be possible for you to backport it to 7.x soon? I have made a change in the file structure finder that uses this and would like that to go into 7.10.

Yes, I'll get that backported today.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >enhancement Team:Data Management Meta label for data/management team v7.10.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add option to output nanoseconds in date ingest processor
5 participants