Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[kemono] 404 NOT FOUND for new posts #1903

Closed
TestPolygon opened this issue Sep 30, 2021 · 7 comments
Closed

[kemono] 404 NOT FOUND for new posts #1903

TestPolygon opened this issue Sep 30, 2021 · 7 comments

Comments

@TestPolygon
Copy link

gallery-dl does not follow redirects, I get for the recently uploaded posts:

[urllib3.connectionpool][debug] Starting new HTTPS connection (3): kemono.party:443
[urllib3.connectionpool][debug] https://kemono.party:443 "GET /6d/cc/6dcc1c5f2abd4234e5512d0ea3cf21eb8b1eb4df54ba069cf6d613d8ac43ee2d.png HTTP/1.1" 404 None
[downloader.http][warning] '404 NOT FOUND' for 'https://kemono.party/6d/cc/6dcc1c5f2abd4234e5512d0ea3cf21eb8b1eb4df54ba069cf6d613d8ac43ee2d.png'

While in the browser https://kemono.party/data/6d/cc/6dcc1c5f2abd4234e5512d0ea3cf21eb8b1eb4df54ba069cf6d613d8ac43ee2d.png
correctly redirects to the new address https://data1.kemono.party/data/6d/cc/6dcc1c5f2abd4234e5512d0ea3cf21eb8b1eb4df54ba069cf6d613d8ac43ee2d.png

@kattjevfel
Copy link
Contributor

Please try #1902 and see if it fixes your issue.

@TestPolygon
Copy link
Author

TestPolygon commented Sep 30, 2021

I did not try, but yeah, gallery-dl have missed /data in the url.
Because of this gallery-dl does not follow redirect, since the initial url is wrong.


Hm, why he does it so.

url = self.root + '/data' + url.replace(self.root, '')

Why not just:

+ url = self.root + '/data' + url
- url = self.root + url

@TestPolygon
Copy link
Author

TestPolygon commented Sep 30, 2021

I'm lazy to check it locally, but visually his commit should not work. May be I'm wrong, but I don't see url in the global scope.
He deleted the url variable, but then he uses it.
Also he uses the strange assignment to url (as I have noted it above)

Also will it work for old urls?


His commit should work only if there is url in the global scope with the full url value.

@mikf mikf closed this as completed in da96856 Sep 30, 2021
@mikf mikf pinned this issue Sep 30, 2021
@mikf
Copy link
Owner

mikf commented Sep 30, 2021

Should work again for newer posts, but I'm getting all sorts of timeout errors for older ones depending on which data server kemono redirects to.

[downloader.http][warning] HTTPSConnectionPool(host='data3.kemono.party', port=443): Read timed out. (read timeout=30.0) (1/5)

@Diadial
Copy link

Diadial commented Oct 9, 2021

Should work again for newer posts, but I'm getting all sorts of timeout errors for older ones depending on which data server kemono redirects to.

[downloader.http][warning] HTTPSConnectionPool(host='data3.kemono.party', port=443): Read timed out. (read timeout=30.0) (1/5)

Hello Mikf. Is this issue retrieving older posts something we can expect some kind of guide or work-around on in the future? Or is this a structural issue with Kemono.party data servers that will not be able to solved?

Thanks.

@mikf
Copy link
Owner

mikf commented Oct 9, 2021

@Diadial it was a structural issue with kemono's data servers, but it seems to be gone now.

@mikf mikf unpinned this issue Oct 9, 2021
@Diadial
Copy link

Diadial commented Oct 10, 2021

@Diadial it was a structural issue with kemono's data servers, but it seems to be gone now.

Ah apologies. I had to update pip & gallery-dl.
Is working correctly now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants