Skip to content
This repository has been archived by the owner on Feb 7, 2024. It is now read-only.

Refactored RateLimitCache to work on a per second basis, rather than per minute #81

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

glennpow
Copy link

@glennpow glennpow commented Sep 6, 2020

This adheres to the current Pushshift API rate-limit of 1 request per second.

https://pypi.org/project/pushshift.py

A minimum rate limit of 1 request per second is used as a default per consultation with Pushshift’s maintainer, /u/Stuck_in_the_matrix.

@dmarx
Copy link
Owner

dmarx commented Oct 2, 2020

Can't just have an interval parameter. You have an implicit n=1: this needs to be explicit and modifiable. At least in theory, the pushshift server has the ability to adjust throttling up or down. Rate limit state is supposed to be reported out to clients via the /meta endpoint. Sounds like the throttling system has been changed without corresponding updates to this endpoint. Further discussion in issue #80.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants