Skip to content

Navigation Menu

Explore
By company size
By use case
By industry
View all solutions
Topics
- AI
- DevOps
- Security
- Software Development
- View all
Explore
- GitHub Sponsors
  Fund open source developers
- The ReadME Project
  GitHub community articles
Repositories
- Enterprise platform
  AI-powered developer platform
Available add-ons
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

WordPress / openverse Public

Notifications You must be signed in to change notification settings
Fork 212
Star 263

Code
Issues 615
Pull requests 9
Discussions
Actions
Projects 4
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Discussions
Actions
Projects
Security
Insights

Add DAG for creating staging indices#3232

Merged

stacimc merged 19 commits intomainWordPress/openverse:mainfrom add/create-staging-index-dagWordPress/openverse:add/create-staging-index-dagCopy head branch name to clipboard

Dec 6, 2023

+457-71

Conversation Commits19 (19)Checks Files changed

Commits

Commits on Nov 15, 2023

Optionally override ES environment in ingestion server
stacimc
committed
Revert "Optionally override ES environment in ingestion server"
stacimc
committed
Add staging ingestion server connection
stacimc
committed

Commits on Nov 16, 2023

Make ingestion server utilities accept optional http_conn_id
stacimc
committed
Make sharedtask for notifying slack
stacimc
committed
Consider ingestion server task active if it has active workers
stacimc
committed
Add recreate_full_staging_index dags
stacimc
committed
Add Dag docs
stacimc
committed
Test DAG parsing
stacimc
committed
Remove unused constant from previous implementation
stacimc
committed
Update DAG tags
stacimc
committed
Respect the data_refresh_limit in reindex task as well as ingest_upstream
stacimc
committed

Commits on Nov 21, 2023

Clarify defaults for data_refresh_limit
stacimc
committed
Simplify the params by making target_alias customizable
stacimc
committed

Commits on Nov 22, 2023

Make media_type a dag param, refactor with TaskFlow
stacimc
committed
Prevent staging DB restore and index creation from simultaneous runs
stacimc
committed
Fix imports to prevent errors when filling DagBag
stacimc
committed
Update dag docs
stacimc
committed
Avoid module name conflicts
stacimc
committed

Footer

© 2024 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Docs
Contact

You can’t perform that action at this time.