Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ruutu.fi has issues downloading. #21031

Closed
5 tasks done
wikuw opened this issue May 9, 2019 · 28 comments
Closed
5 tasks done

Ruutu.fi has issues downloading. #21031

wikuw opened this issue May 9, 2019 · 28 comments

Comments

@wikuw
Copy link

wikuw commented May 9, 2019

  • I'm reporting a broken site support
  • I've verified that I'm running youtube-dl version 2019.04.30
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar issues including closed ones

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'https://www.ruutu.fi/video/3401964']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.04.30
[debug] Python version 2.7.10 (CPython) - Darwin-18.5.0-x86_64-i386-64bit
[debug] exe versions: avconv 12.3, avprobe 12.3, ffmpeg 4.1.3, ffprobe 4.1.3, rtmpdump 2.4
[debug] Proxy map: {}
[Ruutu] 3401964: Downloading XML
[Ruutu] 3401964: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[Ruutu] 3401964: Checking https URL
[Ruutu] 3401964: https URL is invalid, skipping
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 796, in extract_info
ie_result = ie.extract(url)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 529, in extract
ie_result = self._real_extract(url)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/ruutu.py", line 143, in _real_extract
self._sort_formats(formats)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 1326, in _sort_formats
raise ExtractorError('No video formats found')
ExtractorError: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.




Video at given URL works fine on browser.  I have no account at ruutu.fi
@svalavuo
Copy link

svalavuo commented May 10, 2019

Yes. Something is broken/changed.
Tried with ruutu.fi video I have downloaded earlier. Now ruutu.fi tells 403 and after that youtube-dl says that video is DRM protected. Both videos plays nicely with browser.

Upgraded to 2019.05.11, but the result is the same.

@jusrose
Copy link

jusrose commented May 10, 2019

i have it downloaded with pip on linux and it does the same thing. pls show work around and fix on youtube music site as well as regular youtube

@svalavuo
Copy link

With modifications from juzza1 youtube-dl is working with ruutu.fi again! 👍

@matti
Copy link

matti commented May 29, 2019

confimed, works.

@Glimka
Copy link

Glimka commented May 31, 2019

I tested it and it no longer works.
Yes, I have the latest version.

@juzza1
Copy link

juzza1 commented May 31, 2019

I tested it and it no longer works.
Yes, I have the latest version.

I had no problems downloading a few new releases, are you sure you are using my fork, or have applied the pull request into the version you are using? The patch is not yet merged into the master branch. If you are indeed using the patched version, can you please paste the url(s) which did not work for you here.

@Glimka
Copy link

Glimka commented May 31, 2019

The patch is not yet merged into the master branch.

Oh, nevermind then. It was like 2 am when I wrote it and was tired so forgot about that.
I replaced file and it works fine. Sorry for the trouble.

@juzza1
Copy link

juzza1 commented May 31, 2019

The patch is not yet merged into the master branch.

Oh, nevermind then. It was like 2 am when I wrote it and was tired so forgot about that.
I replaced file and it works fine. Sorry for the trouble.

Glad to hear that. To avoid confusion, could you also update your comment in the pull request?

@Jiriss
Copy link

Jiriss commented Jun 9, 2019

Unfortunately this problem is still valid in the newest version

[debug] youtube-dl version 2019.06.08

[Ruutu] 3381638: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[Ruutu] 3381638: Checking https URL
[Ruutu] 3381638: https URL is invalid, skipping

@matti
Copy link

matti commented Jun 10, 2019

because this hasnt been merged?

@matti
Copy link

matti commented Jun 10, 2019

this partch works just fine, downloaded bunch of temppraris

@Glimka
Copy link

Glimka commented Jun 14, 2019

They changed something.
Few days ago it worked and was able to download each video but now I guess I need a subscription.
ERROR: Probably a Ruutu+ video, authentication required. Consider sending PR for proper handling of Ruutu+ videos with credentials.

@matti
Copy link

matti commented Aug 19, 2019

juzza1's patch still works today.

@ronilaukkarinen
Copy link

@juzza1's patch confirmed working just now. Should be merged.

@fuloating
Copy link

fuloating commented Sep 5, 2019

with the patch is it possible to download content that require authentication to ruutu.fi (ruutu+ content) if I provide creds with -u and -p flags?

I applied the patch and can download video that doesn't require login. When I try download something requiring a login, I get the forbidden 403. I have a ruutu.fi account that is a linked gmail account. I tried providing my gmail address in -u parameter and my gmail password in -p parameter.

@matti
Copy link

matti commented Oct 10, 2019

I don't have ruutu account, but I did just downloaded some tempparis so this patch still works at least without login.

@matti
Copy link

matti commented Oct 17, 2019

for anyone who doesn't know git and wants to just use this:

git clone https://github.com/juzza1/youtube-dl.git
cd youtube-dl
git checkout ruutufix
python -m youtube_dl https://www.ruutu.fi/video/2948499

@Jiriss
Copy link

Jiriss commented Nov 8, 2019

When will include the patch to repository under an original project of youtube-dl (https://github.com/ytdl-org/youtube-dl/)?

@svalavuo
Copy link

svalavuo commented Jan 4, 2020

Something is broken again. :-(

[debug] System config: []
[debug] User config: [u'--netrc']
[debug] Custom config: []
[debug] Command-line args: [u'https://www.ruutu.fi/video/3523622', u'--netrc', u'--verbose']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.01.01
[debug] Python version 2.7.12 (CPython) - Linux-4.8.0-32-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: ffmpeg 4.1.3-0york1, ffprobe 4.1.3-0york1, rtmpdump 2.4
[debug] Proxy map: {}
[Ruutu] 3523622: Downloading XML
[Ruutu] 3523622: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[Ruutu] 3523622: Checking https URL
[Ruutu] 3523622: https URL is invalid, skipping
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/youtube_dl/YoutubeDL.py", line 796, in extract_info
ie_result = ie.extract(url)
File "/usr/local/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 530, in extract
ie_result = self._real_extract(url)
File "/usr/local/lib/python2.7/dist-packages/youtube_dl/extractor/ruutu.py", line 143, in _real_extract
self._sort_formats(formats)
File "/usr/local/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 1327, in _sort_formats
raise ExtractorError('No video formats found')
ExtractorError: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Tried to download video from youtube and that worked fine. Issue is in ruutu.fi download.

@svalavuo
Copy link

svalavuo commented Jan 6, 2020

Sorry, that needed ruutu+ and I don't have that.
Tried another:
youtube-dl https://www.ruutu.fi/video/3530318 --netrc --verbose
[debug] System config: []
[debug] User config: [u'--netrc']
[debug] Custom config: []
[debug] Command-line args: [u'https://www.ruutu.fi/video/3530318', u'--netrc', u'--verbose']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.01.01
[debug] Python version 2.7.12 (CPython) - Linux-4.8.0-32-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: ffmpeg 4.1.3-0york1, ffprobe 4.1.3-0york1, rtmpdump 2.4
[debug] Proxy map: {}
[Ruutu] 3530318: Downloading XML
ERROR: This video is DRM protected.
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/youtube_dl/YoutubeDL.py", line 796, in extract_info
ie_result = ie.extract(url)
File "/usr/local/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 530, in extract
ie_result = self._real_extract(url)
File "/usr/local/lib/python2.7/dist-packages/youtube_dl/extractor/ruutu.py", line 141, in _real_extract
raise ExtractorError('This video is DRM protected.', expected=True)
ExtractorError: This video is DRM protected.

@uuksu
Copy link

uuksu commented Jan 8, 2020

It seems that multiple things have changed in Ruutu that causes youtube-dl to break.
New download flow should be something like this to work:

  1. Authenticate to Ruutu.fi, get gatling_token from cookie
  2. Make call to https://gatling.nelonenmedia.fi/media-xml-cache?id=[id here]&v=3 with video id and get playlist url
  3. Make call to https://gatling.nelonenmedia.fi/auth/access/v2?stream=[playlist url here]&timestamp=[timestamp]&gatling_token=[gatling_token here] and get authenticated playlist url (playlist + JWT token in url)
  4. Download from the playlist

@matti
Copy link

matti commented Apr 1, 2020

non-ruutu+ things still work

@joonas-fi
Copy link

@matti has the right answer, things still work (I just confirmed by downloading some stuff) in @juzza1's branch, and he even had instructions on how to use the branch: #21031 (comment) (thanks for being a champ ❤️ )

Here's to hoping the PR gets accepted soon..

@wikuw wikuw closed this as completed May 18, 2020
@wikuw wikuw reopened this May 18, 2020
@ExTechOp
Copy link

ExTechOp commented Jun 7, 2020

Is there some special reason @juzza1's branch hasn't been merged into the main source in six months, if it works?

@ExTechOp
Copy link

Oh how wonderful, the @juzza1 branch is still under RIAA DMCA takedown, although the main youtube-dl source no longer is.

@matti
Copy link

matti commented Nov 24, 2020 via email

@ExTechOp
Copy link

If you do, can you please try to get it merged into the normal youtube-dl, instead of being a special branch?

@matti
Copy link

matti commented Jan 20, 2022

image

^-- regular ffmpeg works just fine now

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests