Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pixiv] Tag downloader does not respect date range #2133

Closed
jgrubs1 opened this issue Dec 23, 2021 · 2 comments
Closed

[pixiv] Tag downloader does not respect date range #2133

jgrubs1 opened this issue Dec 23, 2021 · 2 comments

Comments

@jgrubs1
Copy link

jgrubs1 commented Dec 23, 2021

It appears that gallery-dl ignores the specified date range when downloading tags. The "create_date" filter is useless because of pixiv's 5000 posts limit.

For example, if I try to list all posts tagged with a certain tag or tags during a certain month, I use this syntax:
gallery-dl --no-download "https://www.pixiv.net/en/tags/3D -3D2/artworks?scd=2019-12-01&ecd=2019-12-31&s_mode=s_tag"

The corresponding Web page lists 4,772 results. However, gallery-dl seems to ignore the specified date range, and attempts to download (list, in this case) the entire contents of the tag combination "3D -3D2". This quickly hits pixiv's 5000 posts limit, and fails.

For the same reason using a "create_date" filter in gallery-dl config won't work: gallery-dl will still try listing the whole tag starting from the latest post, and will hit the limit before approaching the specified date range.

Sample link:
gallery-dl --no-download "https://www.pixiv.net/en/tags/3D -3D2/artworks?scd=2019-12-01&ecd=2019-12-31&s_mode=s_tag"

Expected behavior:
gallery-dl lists 4,772 posts that fall in the specified range.

Actual behavior:
gallery-dl lists 5,000 posts starting from the latest (today's) posts, then hits pixiv's 5000 posts limit. No posts in the specified date range are listed.

mikf added a commit that referenced this issue Dec 25, 2021
with the 'scd' and 'ecd' query parameters
@mikf
Copy link
Owner

mikf commented Dec 25, 2021

Dates in scd and ecd now get recognized and used as start_date and end_date parameters in API requests. (4bec34f)

@KonoVitoDa
Copy link

KonoVitoDa commented Mar 3, 2022

@mikf so, how should I use it?

EDIT: Well, I get it to work with scd and ecd, just like OP said (I was firstly trying wih an non-existing date, June 31, hence the error).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants