Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate Ted-Monitor as Source #551

Open
cristianvasquez opened this issue Oct 18, 2024 · 0 comments
Open

Integrate Ted-Monitor as Source #551

cristianvasquez opened this issue Oct 18, 2024 · 0 comments

Comments

@cristianvasquez
Copy link

cristianvasquez commented Oct 18, 2024

Description

Integrate TEDMON as a new data source in the pipeline to enable periodic scheduling of its package transformations. The implementation should support scheduling transformations for multiple packages within a folder or bucket, with the ability to select specific packages based on defined patterns.

Features

  • Source Configuration: Define a file pattern to filter which packages to consume from a folder or S3. By default, all packages are included.
  • Package Handling: For each package, extract the XML notices and schedule a new batch job to process all notices.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant