Skip to content

EEA Crawler contains the tasks (DAGs) used by Apache Airflow to index content from various EEA-Eionet websites into a central Elasticsearch (aka content hub).

Notifications You must be signed in to change notification settings

eea/eea-crawler

Repository files navigation

Airflow and Logstash configurations for EEA-Crawler

See https://github.com/eea/eea.docker.airflow for integration and deployment.

Building this docker image will create a volume that contains the Python code DAGs required for the crawler operation.

About

EEA Crawler contains the tasks (DAGs) used by Apache Airflow to index content from various EEA-Eionet websites into a central Elasticsearch (aka content hub).

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages