-
Notifications
You must be signed in to change notification settings - Fork 16
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Task]: Create Script Entry Point for Transformation Steps #1810
Labels
project: grants.gov
Grants.gov Modernization tickets
Comments
github-project-automation
bot
moved this to Icebox
in Simpler.Grants.gov Product Backlog
Apr 23, 2024
This is a sub-task: #1858 |
jamesbursa
added a commit
that referenced
this issue
May 8, 2024
jamesbursa
moved this from Sprint Ready
to In Progress
in Simpler.Grants.gov Product Backlog
May 8, 2024
margaretspring
moved this from In Progress
to In Review
in Simpler.Grants.gov Product Backlog
May 8, 2024
jamesbursa
added a commit
that referenced
this issue
May 8, 2024
## Summary Fixes #1810 ## Changes proposed - Add an entrypoint that runs the 3 tasks for load and transform in series. ## Context for reviewers The regular load and transform job runs 3 tasks in order: 1. LoadOracleDataTask 2. TransformOracleDataTask 3. SetCurrentOpportunitiesTask This is implemented as a flask command and can be run locally using `poetry run flask data-migration load-transform` ## Additional information Options are available to turn on or off each of the 3 tasks. ``` Options: --load / --no-load run LoadOracleDataTask --transform / --no-transform run TransformOracleDataTask --set-current / --no-set-current run SetCurrentOpportunitiesTask ``` ![Screenshot 2024-05-08 at 12 36 49](https://github.com/HHS/simpler-grants-gov/assets/3811269/488a2045-8209-4046-986d-d55405b394ac)
github-project-automation
bot
moved this from In Review
to Done
in Simpler.Grants.gov Product Backlog
May 8, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Summary
We want to create the entrypoint to the ecs task that handles copying data from the legacy Oracle database, running the transformations, and the running the set current opportunities logic in that order. Each of these steps of the process will be implemented as a class derived from the Task class.
Setting up a script with an entrypoint simply requires adding a bit of boilerplate. For example, you can see some of this boilerplate in how we setup the copy-oracle-data command: https://github.com/HHS/simpler-grants-gov/blob/main/api/src/data_migration/copy_oracle_data.py#L53
This should look something like:
And the command can be run with
poetry run flask data-migration whatever-we-want-to-call-this
Acceptance criteria
No response
The text was updated successfully, but these errors were encountered: