Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(Spankbang) Channels download possible? #30728

Open
3 tasks done
vvglyy opened this issue Mar 8, 2022 · 24 comments · May be fixed by #31010
Open
3 tasks done

(Spankbang) Channels download possible? #30728

vvglyy opened this issue Mar 8, 2022 · 24 comments · May be fixed by #31010

Comments

@vvglyy
Copy link

vvglyy commented Mar 8, 2022

Checklist

  • I'm asking a question
  • I've looked through the README and FAQ for similar questions
  • I've searched the bugtracker for similar questions, including closed ones

Question

Can I use a specific website extractor?
Or I misunderstood something.
Example : Spankbang is present in extractor link, but a channel download isn't possible though.
Tried to download as playlist with no luck.
Can't see any playlist on this site too.
How can I bulk download a channel?
Thanks

@dirkf
Copy link
Contributor

dirkf commented Mar 9, 2022

Example URLs needed, please.

@Izaic
Copy link

Izaic commented Mar 14, 2022

Example URLs needed, please.

Erm, Are you sure you really need those links?

@dirkf dirkf added the nsfw label Mar 14, 2022
@dirkf
Copy link
Contributor

dirkf commented Mar 15, 2022

Haha, but it would be difficult to respond to this issue without knowing what page OP wants yt-dl to handle.

By convention maintainers don't judge the content of a supported site that meets the criteria on the Site Support template, though any maintainer is free to ignore issues related to a site without having to justify so doing.

@afterdelight
Copy link
Contributor

What do you need? a playlist url or a channel url?

@vvglyy
Copy link
Author

vvglyy commented Mar 23, 2022

I can give what I said a URL of a guys/gurlz channel --> Videos like in YouTube... I go to a channel and then to its videos and add playlist in my command line. It's maybe more understable I guess now.

In YouTube I go to a channel I like then to its videos, and :
-Uv -f bestvideo+bestaudio/best --download-archive archive.txt --merge-output-format MKV -i --all-subs --embed-subs --add-metadata --write-info-json --write-description -o "%(uploader)s/%(upload_date)s - %(title)s %(id)s.%(ext)s" --yes-playlist --cookies-from-browser firefox "**_playlist_**"

Well, for now I use yt-dlp as it work on YouTube quite great and my command line is :
yt-dlp -Uv -f bestvideo+bestaudio/best --no-check-certificate --download-archive archive.txt --merge-output-format MKV -i --all-subs --embed-subs --add-metadata --write-info-json --write-description -o "%(uploader)s/%(upload_date)s - %(title)s %(id)s.%(ext)s" --yes-playlist --cookies-from-browser firefox "**_playlist_**""

A channel of a RANDOM guy 😅

What's difference with other Extractor? It's switching automaticly?

@vvglyy
Copy link
Author

vvglyy commented Mar 23, 2022

What do you need? a playlist url or a channel url?

Here i can say there's no playlist on Spankbang? Am I wrong?

Then, Example URLs needed, please. I'm interested 😂

@afterdelight

This comment was marked as spam.

@vvglyy
Copy link
Author

vvglyy commented Jun 6, 2022

It works but for a more than 78 videos playlists, it downloads only 78 videos.

WARNING: [SpankBangPlaylist] unable to extract playlist title; please report this issue on https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using yt-dlp -U

@vvglyy
Copy link
Author

vvglyy commented Jun 6, 2022

Example for the 3rd playlist https://spankbang.com/9c8v/playlist/xcw which contain 140 videos from @afterdelight list :

yt-dlp -Uv -f "(mp4)[height<=?720][tbr>500]" --no-check-certificate --yes-playlist --cookies-from-browser firefox "https://fr.spankbang.com/9c8v/playlist/xcw"
[debug] Command-line config: ['-Uv', '-f', '(mp4)[height<=?720][tbr>500]', '--no-check-certificate', '--yes-playlist', '--cookies-from-browser', 'firefox', 'https://fr.spankbang.com/9c8v/playlist/xcw']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version 2022.05.18 [b14d523] (zip)
[debug] Python version 3.10.4 (CPython 64bit) - macOS-12.4-x86_64-i386-64bit
[debug] Checking exe version: ffprobe -bsfs
[debug] Checking exe version: ffmpeg -bsfs
[debug] exe versions: ffmpeg 4.4.1 (setts), ffprobe 4.4.1
[debug] Optional libraries: certifi-2022.05.18.1, sqlite3-2.6.0
[Cookies] Extracting cookies from firefox
[debug] Extracting cookies from: "/Users/vvglyywzxit/Library/Application Support/Firefox/Profiles/vt78fq64.default-release-1-1650662348786/cookies.sqlite"
[Cookies] Extracted 2551 cookies from firefox
[debug] Proxy map: {}
Latest version: 2022.05.18, Current version: 2022.05.18
yt-dlp is up to date (2022.05.18)
[debug] [SpankBangPlaylist] Extracting URL: https://fr.spankbang.com/9c8v/playlist/xcw
[SpankBangPlaylist] 9c8v: Downloading webpage
WARNING: [SpankBangPlaylist] unable to extract playlist title; please report this issue on https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using yt-dlp -U
[download] Downloading playlist: 9c8v
[SpankBangPlaylist] playlist 9c8v: Collected 78 videos; downloading 78 of them
[download] Downloading video 1 of 78
[debug] [SpankBang] Extracting URL: https://fr.spankbang.com/9c8v-g3qyqz/playlist/xcw
[SpankBang] g3qyqz: Downloading webpage
[SpankBang] g3qyqz: Downloading stream JSON
[SpankBang] g3qyqz: Downloading m3u8 information
[SpankBang] g3qyqz: Downloading m3u8 information
[SpankBang] g3qyqz: Downloading m3u8 information
[SpankBang] g3qyqz: Downloading m3u8 information
[debug] Formats sorted by: hasvid, ie_pref, lang, quality, res, fps, hdr:12(7), vcodec:vp9.2(10), acodec, filesize, fs_approx, tbr, vbr, abr, asr, proto, vext, aext, hasaud, source, id
[info] g3qyqz: Downloading 1 format(s): hls-2530-1
[debug] Invoking hlsnative downloader on "https://hls-uranus.sb-cd.com/hls/1/1/11581153-720p.mp4/index-v1-a1.m3u8?_tid=11581153&d=2&m=9&secure=QSLN_-EMPKCH1IZLFNlmCg,1654535193"
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 346
[download] Destination: Lesbian Bikini Raslin [g3qyqz].mp4
[download] 2.9% of ~303.21MiB at 2.12MiB/s ETA 02:32 (frag 10/346)^C
ERROR: Interrupted by user

@afterdelight
Copy link
Contributor

maybe it only downloaded 1st page?

@dirkf
Copy link
Contributor

dirkf commented Jun 6, 2022

  1. Feel free to post issues concerning yt-dlp in the yt-dlp issue tracker.

  2. In this particular case, the SpankBangPlaylist extractor uses the same code, though that would not necessarily guarantee the same behaviour.

  3. The extractor has no pagination: it only finds the items linked in the first playlist page.

  4. It finds each item twice because the search pattern is not strict enough and it uses the playlist_result() method instead of playlist_from matches() (which includes de-duplication).

@vvglyy vvglyy closed this as completed Jun 6, 2022
@dirkf dirkf linked a pull request Jun 6, 2022 that will close this issue
11 tasks
@afterdelight
Copy link
Contributor

why did u close this?

@afterdelight
Copy link
Contributor

what about channel download?

@dirkf
Copy link
Contributor

dirkf commented Jun 7, 2022

OP closed the issue. The example URLs listed above appear to work in PR #31010.

@vvglyy
Copy link
Author

vvglyy commented Jun 7, 2022

what about channel download?

Channels aren't playlists, there's no way to download a channel AFAIK :/

why did u close this?

Because there is an answer to this issue : “The extractor has no pagination: it only finds the items linked in the first playlist page.”

It's more a request, then, right?

It works, but only for the 1st page. Should I reopen for that? I can, let me know.

Or feel free to open a request, I guess.

@dirkf
Copy link
Contributor

dirkf commented Jun 7, 2022

PR #31010 does the pagination. If you re-open the issue it'll be closed automatically when the PR is merged.

As the provided examples were of playlists and not channels, those are what gets paginated. But I see also https://fr.spankbang.com/profile/daniellarthurr131/videos.

@vvglyy vvglyy reopened this Jun 7, 2022
@dirkf
Copy link
Contributor

dirkf commented Jun 7, 2022

All these pages have a similar structure to playlist pages

  • category
  • tag
  • search
  • channel
  • star
  • profile.

All very similar to the listing pages in XVideos, and now handled in #31010.

@afterdelight

This comment was marked as off-topic.

@vvglyy
Copy link
Author

vvglyy commented Jun 8, 2022

All very similar to the listing pages in XVideos, and now handled in #31010.

Just have to update and
-Uv -f "(mp4)[height<=?720][tbr>500]" --no-check-certificate --yes-playlist --cookies-from-browser firefox "https://fr.spankbang.com/9c8v/playlist/xcw" will download all videos from the playlist?

Same for channels?

Thanks.

@dirkf
Copy link
Contributor

dirkf commented Jun 8, 2022

The new spankbang.py might work with yt-dlp but hasn't been tested.

To test the PR, use pip to install it; you'll also get fixes from the git master level (04fd328) from which the branch was cloned.

Apparently the URL to pass to pip for this is https://github.com/ytdl-org/youtube-dl/tarball/pull/31010/head.

@vvglyy
Copy link
Author

vvglyy commented Jun 8, 2022

I use youtube-dl now. What's the difference between youtube-dl and yt-dlp?
Well, I installed both.

@vvglyy
Copy link
Author

vvglyy commented Jun 8, 2022

To test the PR, use pip to install it; you'll also get fixes from the git master level (04fd328) from which the branch was cloned.

Apparently the URL to pass to pip for this is https://github.com/ytdl-org/youtube-dl/tarball/pull/31010/head.

I've got this error (macOS, installed via macports : python, pip, git)

In Terminal :
python -m pip install git+https://github.com/ytdl-org/youtube-dl/tarball/pull/31010/head

Defaulting to user installation because normal site-packages is not writeable
Collecting git+https://github.com/ytdl-org/youtube-dl/tarball/pull/31010/head
Cloning https://github.com/ytdl-org/youtube-dl/tarball/pull/31010/head to /private/var/folders/1q/qb_v7bnn3zn0d42zm4n0x5dh0000gn/T/pip-req-build-o1q2vb6_
Running command git clone --filter=blob:none --quiet https://github.com/ytdl-org/youtube-dl/tarball/pull/31010/head /private/var/folders/1q/qb_v7bnn3zn0d42zm4n0x5dh0000gn/T/pip-req-build-o1q2vb6_
remote: 404: Not Found
fatal: dépôt 'https://github.com/ytdl-org/youtube-dl/tarball/pull/31010/head/' non trouvé
error: subprocess-exited-with-error

× git clone --filter=blob:none --quiet https://github.com/ytdl-org/youtube-dl/tarball/pull/31010/head /private/var/folders/1q/qb_v7bnn3zn0d42zm4n0x5dh0000gn/T/pip-req-build-o1q2vb6_ did not run successfully.
│ exit code: 128
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× git clone --filter=blob:none --quiet https://github.com/ytdl-org/youtube-dl/tarball/pull/31010/head /private/var/folders/1q/qb_v7bnn3zn0d42zm4n0x5dh0000gn/T/pip-req-build-o1q2vb6_ did not run successfully.
│ exit code: 128
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

'Defaulting to user installation because normal site-packages is not writeable'

I think it's this, that cause the error, right? How to force install in the normal site-packages folder?

@dirkf
Copy link
Contributor

dirkf commented Jun 8, 2022

Just https://...

Ignore the yt-dlp comment which I made after misreading your command line.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants