Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

URL parse ingest processor #65772

Closed
mbudge opened this issue Dec 2, 2020 · 2 comments
Closed

URL parse ingest processor #65772

mbudge opened this issue Dec 2, 2020 · 2 comments
Labels
:Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >enhancement Team:Data Management Meta label for data/management team

Comments

@mbudge
Copy link

mbudge commented Dec 2, 2020

Hi,

A URL parse ingest processor would be useful for security and other network data.

The processor could parse the full URL and populate the following ECS fields

url.extension
url.fragment
url.password
url.path
url.port
url.query
url.scheme
url.username

https://www.elastic.co/guide/en/ecs/current/ecs-url.html

Sometimes the scheme is missing from the full URL, so it would be good if the processor could parse URL's with no scheme without failing.

Thanks

@mbudge mbudge added >enhancement needs:triage Requires assignment of a team area label labels Dec 2, 2020
@jrodewig
Copy link
Contributor

jrodewig commented Dec 2, 2020

Hi @mbudge,

It sounds like the URI parts processor added with #65150 would fit your needs:
https://www.elastic.co/guide/en/elasticsearch/reference/master/uri-parts-processor.html

I'm going to close this issue. Please feel free to re-open if I overlooked something. Thanks!

@jrodewig jrodewig closed this as completed Dec 2, 2020
@jrodewig jrodewig added :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP and removed needs:triage Requires assignment of a team area label labels Dec 2, 2020
@elasticmachine elasticmachine added the Team:Data Management Meta label for data/management team label Dec 2, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-features (Team:Core/Features)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >enhancement Team:Data Management Meta label for data/management team
Projects
None yet
Development

No branches or pull requests

3 participants