Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a 1 minute retry if rate limitted so execution can run to completion #1

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

MinhNgyuen
Copy link

Problem: Execution can grind to a halt midway through if a rate limit is encountered and progress (search and llm usage) will be lost

Solution: If the rate limit is encountered, go to sleep for 1 minute until the tokens per minute rate limit is refreshed.

Testing:

  • Ran this code
  • Encountered the rate limit 5+ times
  • Verified with the print statement that execution went to sleep for 1 minute for the rate limit
  • Execution progressed as normal after the sleep

Claude rate limits

@meetbryce
Copy link

This worked great for me! @mshumer you should totally merge this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants