Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set up a cron job via github actions to update data nightly #1535

Closed
edwinjue opened this issue Aug 9, 2023 · 3 comments
Closed

Set up a cron job via github actions to update data nightly #1535

edwinjue opened this issue Aug 9, 2023 · 3 comments
Labels
Good First Issue Good for newcomers P-feature: Content Role: Frontend React front end work Size: 5pt Can be done in 19-30 hours Tech Stack: New

Comments

@edwinjue
Copy link
Member

edwinjue commented Aug 9, 2023

Overview

Basically port over this workflow to the new tech stack:
https://github.com/edwinjue/311-data-v2-gh-pages/blob/main/.github/workflows/hfUpdate.yml

Action Items

Resources/Instructions

https://github.com/edwinjue/311-data-v2-gh-pages/blob/main/.github/workflows/hfUpdate.yml

@bberhane
Copy link
Member

bberhane commented Jun 3, 2024

@mru-hub Howdy! Is this job still being worked on?

@ryanfchase
Copy link
Member

I think this ticket is actually done, we are getting 2024 data nightly.

Worth noting, I don't think our updateHfDataset.py previous year data -- @Skydodle does that sound correct? I guess the caveat is that only 2024 data is expected to change, but I suppose we can't know that for certain.

I'm still going to close this ticket, but I'll be bringing this ticket up in discussion on the next engineering meeting.

@Skydodle
Copy link
Member

Skydodle commented Jun 4, 2024

I think this ticket is actually done, we are getting 2024 data nightly.

Worth noting, I don't think our updateHfDataset.py previous year data -- @Skydodle does that sound correct? I guess the caveat is that only 2024 data is expected to change, but I suppose we can't know that for certain.

I'm still going to close this ticket, but I'll be bringing this ticket up in discussion on the next engineering meeting.

Yes correct, the cron job only updates 2024 or current year data. The prior years data are completed and therefore does not need to update daily.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Good First Issue Good for newcomers P-feature: Content Role: Frontend React front end work Size: 5pt Can be done in 19-30 hours Tech Stack: New
Projects
Status: Done (without merge)
Development

No branches or pull requests

8 participants