Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Request sites to support here #8

Open
4pr0n opened this issue Apr 5, 2014 · 192 comments
Open

Request sites to support here #8

4pr0n opened this issue Apr 5, 2014 · 192 comments
Labels
discussion enhancement help wanted needs examples

Comments

@4pr0n
Copy link
Owner

4pr0n commented Apr 5, 2014

PLEASE include an example URL of the type of album to rip.

Supported sites + commits:

Pending sites + examples (NSFW):

Enhancement requests:

  • flickr - login support (see Flickr Rip Support Limited #32)
  • vk - Video ripper rename files
  • twitter - Search ripping
  • gifyo - Don't skip some images
  • *chan rippers - Handle external links (vocaroo), store comments
  • tumblr - Rip by date (/archive/year/month)
@4pr0n 4pr0n changed the title Rip from these sites Request sites to support here Apr 6, 2014
@CaspianRoach
Copy link

wakaba threads on imageboards (such as 4chan or more examples here http://allchans.org/)

Random example: http://desuchan.net/v/res/7034.html
Can probably be done by retrieving all that point to an image file extension. Or constricted to /src/ folder.

With that in mind, maybe this method can be expanded to allow the ripping of 'generic' web album pages, the ones that link directly to the files.

@4pr0n
Copy link
Owner Author

4pr0n commented Apr 12, 2014

I'll look into supporting generic *chan* sites.

maybe this method can be expanded to allow the ripping of 'generic' web album pages, the ones that link directly to the files.

For that, there's already DownThemAll, the Firefox add-on which works really well.

4pr0n added a commit that referenced this issue Apr 12, 2014
@4pr0n
1.0.17 - Added generic *chan ripper #8
cfb99e0
@4pr0n
Copy link
Owner Author

4pr0n commented Apr 13, 2014

maybe this method can be expanded to allow the ripping of 'generic' web album pages, the ones that link directly to the files.

I've had an idea for a ripper that can scrape anything, like random message boards that link to imagebam.com galleries or imgur albums. It would default to just try to scrape the page if the host isn't strictly supported. It would require refactoring the existing rippers, and adding a ton of one-off single-image hosts (imagetwist etc) which would be painful, but it's possible.

@CaspianRoach
Copy link

Not sure if it's worth your time, but there's this site:
http://kinkyshare.com
and I just can't leave it because I'm constantly opening new images from the bottom side :)

anyway, they sometimes have galleries like this http://kinkyshare.com/c/1857/blonde_and_brunette_margo_et_lilas_-_amiti_et_complicit
and this http://kinkyshare.com/c/1384/gia_felino_-_barbie_latex_catsuit

If it's not too much trouble a ripper for albums or even tag pages here would be nice.

@CaspianRoach
Copy link

Pornhub seems to have a decent number of albums, too.
http://www.pornhub.com/albums
It feels like a popular enough site to bother with a ripper for it.

@domonic46
Copy link

Request for support for:
Butttoucher.com
getgonewild.com
i.rarchives.com user pages
and teenplanet.org
Thank you for making this ripper!

@4pr0n
Copy link
Owner Author

4pr0n commented Apr 20, 2014

Request for support for:
Butttoucher.com
getgonewild.com
i.rarchives.com user pages

Instead of waiting for these rippers to be implemented, try ripping http://gonewild.com/user/username (replace username with the user's name). It's more exhaustive than the above sites but doesn't always have the user.

@slipl
Copy link

slipl commented Apr 21, 2014

Is Photobucket on the list?

@4pr0n
Copy link
Owner Author

4pr0n commented Apr 21, 2014

Is Photobucket on the list?

It is now. Stay (patiently) tuned

4pr0n added a commit that referenced this issue Apr 21, 2014
@4pr0n
Added butttoucher ripper #8
0e04590
4pr0n added a commit that referenced this issue Apr 21, 2014
@4pr0n
Added naive support for i.rarchives.com rips #8
20b3974
4pr0n added a commit that referenced this issue Apr 21, 2014
@4pr0n
1.0.23 - Added teenplanet album ripper #8
acc7f87
@4pr0n
Copy link
Owner Author

4pr0n commented Apr 21, 2014

3 commits above are in latest version & ripme should be updateable to this version.

@domonic46: getgonewild doesn't appear to work -- I can't find any "profiles" that contain imgur links. Hence the bolded text in OP:

Requests must include an example URL

@slipl
Copy link

slipl commented Apr 22, 2014

Flickr support would be very nice too, thanks!

@Jar4ek
Copy link

Jar4ek commented Apr 22, 2014

Request for support for:
flickr.com | For example, the photo on this page is not available download option. https://www.flickr.com/photos/beargills/

artician.com
pixiv.net

Thank you for making this ripper!

4pr0n added a commit that referenced this issue Apr 23, 2014
@4pr0n
1.0.25 - Added photobucket ripper #8
2875ee8
@crimble
Copy link

crimble commented Apr 24, 2014

Possible to add a video ripper for something like this
http://vk.com/videos213696261

4pr0n added a commit that referenced this issue Apr 24, 2014
@4pr0n
1.0.27 - Added flickr ripper #8
bf100f2
4pr0n added a commit that referenced this issue Apr 24, 2014
@4pr0n
1.0.28 - Added Vk video (single and albums) rippers #8
e5906db
@4pr0n
Copy link
Owner Author

4pr0n commented Apr 24, 2014

Haven't fully tested the VK video album ripper (hard to with a sample album of 2,000+ videos). It starts downloading them, so I guess it works.

@Jar4ek
Copy link

Jar4ek commented Apr 24, 2014

Recently I asked for support for Flickr page and it works very good, but there is a problem. Namely, the pictures were downloaded link only partially.

Link: https://www.flickr.com/photos/beargills/ to 1,470 images downloaded only 100 photos. I'd asked for a solution to this problem.

Next Link : www.flickr.com/photos/gestiefeltekatze to 1,290 images downloaded only 100 photos. I'd asked for a solution to this problem.

I also failed to download photos from this site:

https://www.flickr.com/photos/bubuyalove/

I also would ask for support downloading photos from the 500px.com

If there is such a possibility, please let me know the solution to this problem.

Best Regards Jarek.

@crimble
Copy link

crimble commented Apr 25, 2014

The VK video ripper is working great so far but before I attempt all 2,000+ videos, are there any original file names available to replace the current output?

What I'm getting now:
001_f4fc9d1705.720.mp4
002_dc3bda4117.720.mp4
003_9bc4105e2d.720.mp4

4pr0n added a commit that referenced this issue Apr 25, 2014
@4pr0n
Flickr ripper iterates over pages #8
b8974ca
@4pr0n
Copy link
Owner Author

4pr0n commented Apr 25, 2014

Looks like Flickr changed the login scheme to use javascript to set cookies that are required for logging in. The scheme is too complex for me to bother with. This means the Flickr ripper can't rip NSFW images.

I left the code to login (which used to work a few months ago) in case someone else wants to pick it up.

@ghost
Copy link

ghost commented Apr 25, 2014

Request for support for
MINUS
http://exogallery.minus.com/mYzoL2DVlmXMJ

@erofanboy
Copy link

is it possible to rip partially tumblr archives, e.g. http://***.tumblr.com/archive/2014/4 ?

4pr0n added a commit that referenced this issue Apr 25, 2014
@4pr0n
1.0.30 - Added Minus ripper #8
55aef94
@cyian-1756
Copy link
Contributor

@anivia123 I'm not really sure that ripme should support http://apina.nwps.ws. It looks a lot like a generic junk site (it's faking the total visitors, links to a chat site at the top of every page), it has very limit content and very rare updates, it seems to be on free hosting, it seems to be made to fool users into thinking it's an open directory (it lists index.php) and it has a bunch of domain names that all point to the same site.

@cyian-1756 cyian-1756 mentioned this issue Mar 28, 2017
Merged
@rudolphos
Copy link

Can vsco please be added ?
User above posted the request, but it was not referenced.

@cyian-1756
Copy link
Contributor

@rudolphos

@domonic46

It looks like ripme can't support vsco as the site requires javascript to load images and ripme does not have a javascript engine

This was referenced Apr 6, 2017
Closed
Closed
@MrBiggz007
Copy link

@cyian-1756 I can't seen to find my original post, but here are some example links I just grabbed off the pages:

http://forum.oneclickchicks.com/showthread.php?t=47951
http://forum.oneclickchicks.com/showthread.php?t=68338

Also, is there a way to rip your own "my likes" album on Tumblr? I can rip my posted photos easily but I can't get "my likes" to rip?

@cyian-1756
Copy link
Contributor

@MrBiggz007

Also, is there a way to rip your own "my likes" album on Tumblr?

I have no idea. You might be able to just rip it like any tumblr page.

I can't get "my likes" to rip?

What error message (if any) do you get?

@MrBiggz007
Copy link

MrBiggz007 commented Apr 19, 2017 via email

@metaprime
Copy link
Collaborator

I'm locking this issue and diverting discussion to the new issue #502. Feel free to link back to comments on this issue. Thanks for understanding!

Repository owner locked and limited conversation to collaborators Apr 25, 2017
@metaprime
Copy link
Collaborator

Oh, looks like if I lock an issue I can't use reactions to keep track of which items I've listed in #510. So I guess I'm unlocking the issue. Use your discretion, but I'd still urge people to move their discussions to #502.

Repository owner unlocked this conversation Apr 25, 2017
This was referenced Apr 25, 2017
Closed
Open
@Flip32
Copy link

Flip32 commented Jun 7, 2017

Hi, It seems Imagebam it's not working! And when does, the pics come smaller.

ex.: http://www.imagebam.com/gallery/72c5utvqv44wcqnkc9vzapm5yck8j1cr

@cyian-1756
Copy link
Contributor

@Flip32 Can you make a entirely new issue please? This issue was for tracking site support and has since been replaced

@jimbotomato
Copy link

XHamster changed their gallery URL format so Ripme doesn't detect it anymore, could I most humbly request for an update to fix this please? =)

Previously:
xha*****.com/photos/gallery/@@numbers@@/@@name@@.html

Now:
xha******.com/photos/gallery/@@name@@-@@numbers@@

@spartan9362
Copy link

Could you make a vsco.co/ ripper please it's a very good site Example: vsco.co/samdavis125 and vsco.co/samdavis125/images/1

@XeonPhobia
Copy link

XeonPhobia commented Jul 11, 2017 •
edited
Loading

I'm trying to add support for imgsrc.ru site, however I have a few issues, does anyone know how to get all URLs with data-src like the example below into an array with getURLsFromPage? Is there more documentation or tutorials on these kinds of problems?

a href='#54225016_next'> img class='big lazyload' data-src='http://URLj.jpg' src='URL'
</a

(had to remove some <>)

@cyian-1756
Copy link
Contributor

Is there more documentation or tutorials on these kinds of problems?

Check out the wiki

@metaprime
Copy link
Collaborator

Please make new requests at #502

This was referenced Aug 10, 2017
Open
Open
@metaprime metaprime mentioned this issue Nov 30, 2017
Open
@arjung24
Copy link

arjung24 commented Aug 6, 2021

Haven't fully tested the VK video album ripper (hard to with a sample album of 2,000+ videos). It starts downloading them, so I guess it works.

Can u please help?? What will be the vk single video and vk album video format for ripping 🙏🙏🙏

@123andreas4
Copy link

Thx

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
discussion enhancement help wanted needs examples
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests