Skip to content

Commit

Permalink
Add caching to the crawler to prevent disappearing entries in TODO.md
Browse files Browse the repository at this point in the history
  • Loading branch information
timschneeb authored Dec 23, 2023
1 parent 2209979 commit 21bbd11
Showing 1 changed file with 14 additions and 0 deletions.
14 changes: 14 additions & 0 deletions .github/workflows/run-crawler.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,13 @@ jobs:
- name: Install dependencies
run: |
pip install -r requirements.txt
- name: Restore cache
id: cache-primes-restore
uses: actions/cache/restore@v3
with:
path: cache/
key: crawler-cache

- name: Run crawler
env:
Expand All @@ -42,6 +49,13 @@ jobs:
python main.py ./list
cat ./list/pages/TODO.md >> $GITHUB_STEP_SUMMARY
- name: Save cache
id: cache-primes-save
uses: actions/cache/save@v3
with:
path: cache/
key: crawler-cache

- name: Publish summary changes
uses: stefanzweifel/git-auto-commit-action@v4
with:
Expand Down

0 comments on commit 21bbd11

Please sign in to comment.