Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Discovery] Add former Scripps channels #17947

Closed
5 of 9 tasks
StevenDTX opened this issue Oct 22, 2018 · 20 comments
Closed
5 of 9 tasks

[Discovery] Add former Scripps channels #17947

StevenDTX opened this issue Oct 22, 2018 · 20 comments

Comments

@StevenDTX
Copy link

Please follow the guide below

  • You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
  • Put an x into all the boxes [ ] relevant to your issue (like this: [x])
  • Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.10.05. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

  • I've verified and I assure that I'm running youtube-dl 2018.10.05

Before submitting an issue make sure you have:

  • At least skimmed through the README, most notably the FAQ and BUGS sections
  • Searched the bugtracker for similar issues including closed ones
  • Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

E:\>youtube-dl "https://watch.foodnetwork.com/tv-shows/trishas-southern-kitchen/full-episodes/trishas-space-kitchen" --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://watch.foodnetwork.com/tv-shows/trishas-southern-kitchen/full-episodes/trishas-space-kitchen', '--verbose']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2018.10.05
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.17134
[debug] exe versions: ffmpeg N-89980-ge752da5464, ffprobe N-89980-ge752da5464, rtmpdump 2.4
[debug] Proxy map: {}
[generic] trishas-space-kitchen: Requesting header
WARNING: Falling back on generic information extractor.
[generic] trishas-space-kitchen: Downloading webpage
[generic] trishas-space-kitchen: Extracting information
ERROR: Unsupported URL: https://watch.foodnetwork.com/tv-shows/trishas-southern-kitchen/full-episodes/trishas-space-kitchen
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp5xdqinp2\build\youtube_dl\YoutubeDL.py", line 792, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp5xdqinp2\build\youtube_dl\extractor\common.py", line 507, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp5xdqinp2\build\youtube_dl\extractor\generic.py", line 3298, in _real_extract
youtube_dl.utils.UnsupportedError: Unsupported URL: https://watch.foodnetwork.com/tv-shows/trishas-southern-kitchen/full-episodes/trishas-space-kitchen

Discovery purchased Scripps earlier this year and some channels have been updated to use the Discovery format. The Discovery extractor needs to be updated to recognize the new URLs.

Updated:
watch.foodnetwork.com
watch.hgtv.com

Not updated yet:
watch.cookingchannel.com
watch.diynetwork.com
watch.travelchannel.com

@tv21
Copy link

tv21 commented Oct 24, 2018

Here's an example of a hgtv link that fails because of this - note that URL's from the former Scripps channels begin with "watch", not "www":

https://watch.hgtv.com/tv-shows/island-life/full-episodes/old-friends-in-ocean-city-md

@tv21
Copy link

tv21 commented Oct 24, 2018

I tested VietTPham's patch but now I get "ERROR: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies." EDIT: If you do that (see below) then the patch works, at least it does for me. Thank you, VietTPham.

@StevenDTX
Copy link
Author

The --ap-mso stuff has never worked with Discovery channels. You must use cookies.

@tv21
Copy link

tv21 commented Oct 25, 2018

Thanks - I never had any idea how to do that but found the instructions at https://github.com/rg3/youtube-dl#how-do-i-pass-cookies-to-youtube-dl and now it does work with VietTPham's patch.

@ghost
Copy link

ghost commented Oct 26, 2018

Does that mean you need to sign in with a provider to get the cookie? - Tried testing the patch here, but as I dont have an account, I cant create the cookie.

@tv21
Copy link

tv21 commented Oct 27, 2018

Yes, you have to be able to login to the web site using a provider account.

@sydbat
Copy link

sydbat commented Oct 30, 2018

So this means that all the people who have dropped cable are no longer able to watch videos on HGTV (and other Discovery websites I imagine) because you require a cable subscription to sign in? There are no free videos to watch there since the site switched over last week. I also suppose there is no way of getting the cookie required without signing in, which means having to get cable again, which means what is the point.

@ricknorton
Copy link

So this means that all the people who have dropped cable are no longer able to watch videos on HGTV (and other Discovery websites I imagine) because you require a cable subscription to sign in? There are no free videos to watch there since the site switched over last week. I also suppose there is no way of getting the cookie required without signing in, which means having to get cable again, which means what is the point.

There are still free videos to watch that don't require sign on. For example:
https://watch.hgtv.com/tv-shows/rustic-rehab/full-episodes/different-level-of-renovations

The point for me is being able to DL these at home (with the cookie when required - because I have a cable sub - or without the cookie when possible) means I can background watch these at work since I can't login due to network restrictions.

Hopefully, the pending fix is implemented soon. Thanks for the work on this :)

@ghost
Copy link

ghost commented Nov 4, 2018

Been testing the patch further with Free Videos, and every 1 hour or so I get this.

ERROR: Access to the requested resource path is unauthorized: v1/streaming/video/<videoID> [The access token provided has expired]; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Traceback (most recent call last):
  File "/home/user/Downloads/youtube-dl/youtube_dl/extractor/discovery.py", line 89, in _real_extract
    'Authorization': 'Bearer ' + access_token,
  File "/home/user/Downloads/youtube-dl/youtube_dl/extractor/common.py", line 865, in _download_json
    expected_status=expected_status)
  File "/home/user/Downloads/youtube-dl/youtube_dl/extractor/common.py", line 843, in _download_json_handle
    expected_status=expected_status)
  File "/home/user/Downloads/youtube-dl/youtube_dl/extractor/common.py", line 633, in _download_webpage_handle
    urlh = self._request_webpage(url_or_request, video_id, note, errnote, fatal, data=data, headers=headers, query=query, expected_status=expected_status)
  File "/home/user/Downloads/youtube-dl/youtube_dl/extractor/common.py", line 618, in _request_webpage
    raise ExtractorError(errmsg, sys.exc_info()[2], cause=err)

ExtractorError: Unable to download JSON metadata: HTTP Error 401: Unauthorized (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/home/user/Downloads/youtube-dl/youtube_dl/YoutubeDL.py", line 792, in extract_info
    ie_result = ie.extract(url)
  File "/home/user/Downloads/youtube-dl/youtube_dl/extractor/common.py", line 508, in extract
    ie_result = self._real_extract(url)
  File "/home/user/Downloads/youtube-dl/youtube_dl/extractor/discovery.py", line 101, in _real_extract
    raise ExtractorError(e_description)

ExtractorError: Access to the requested resource path is unauthorized: v1/streaming/video/<videoID> [The access token provided has expired]; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

It looks like the access token is not quite refreshing as expected, run the download a few more time and eventually it will pick up again. It does not appear to be related to any particular video. Is this related to the sites (HGTV and FoodNetwork) or is this a quirk of the Discovery downloader.

EDIT: Formatting

@NEET-Engineer
Copy link

Cooking Channel has updated to:
https://watch.cookingchanneltv.com/tv-shows/good-eats-reloaded/full-episodes/for-whom-the-cheese-melts

@domsmrc
Copy link

domsmrc commented Nov 18, 2018

Travel Channel also updated their site. For example:
https://watch.travelchannel.com/tv-shows/ghost-adventures/full-episodes/manresa-castle
Please, add support for this site also. Thank you in advance.

@ricknorton
Copy link

DIY Network has changed to this Discovery system as well:
https://watch.diynetwork.com/tv-shows/

@dnlzzxz
Copy link

dnlzzxz commented Dec 17, 2018

Hello, [DIY Network] is not working.

Does someone have a solution?

>youtube-dl --write-sub -a list.txt --cookies cookies.txt -v -C [debug] System config: [] [debug] User config: [] [debug] Custom config: [] [debug] Command-line args: ['--write-sub', '-a', 'list.txt', '--cookies', 'cookies.txt', '-v', '-C'] [debug] Batch file urls: ['https://watch.diynetwork.com/tv-shows/building-off-the-grid/full-episodes/building-off-the-grid', 'https://watch.diynetwork.com/tv-shows/building-off-the-grid/full-episodes/alaska', 'https://watch.diynetwork.com/tv-shows/building-off-the-grid/full-episodes/north-pole', 'https://watch.diynetwork.com/tv-shows/building-off-the-grid/full-episodes/yurts-so-good', 'https://watch.diynetwork.com/tv-shows/building-off-the-grid/full-episodes/gnome-sweet-home', 'https://watch.diynetwork.com/tv-shows/building-off-the-grid/full-episodes/rocky-mountains', 'https://watch.diynetwork.com/tv-shows/building-off-the-grid/full-episodes/alaska-range'] [debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252 [debug] youtube-dl version 2018.12.17 [debug] Python version 3.4.4 (CPython) - Windows-10-10.0.17134 [debug] exe versions: ffmpeg 4.1, ffprobe 4.1 [debug] Proxy map: {} [debug] Public IP address: xxx.xxx.xxx.xxx [generic] building-off-the-grid: Requesting header WARNING: Falling back on generic information extractor. [generic] building-off-the-grid: Downloading webpage [generic] building-off-the-grid: Extracting information ERROR: Unsupported URL: https://watch.diynetwork.com/tv-shows/building-off-the-grid/full-episodes/building-off-the-grid Traceback (most recent call last): File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp5g6wx9_e\build\youtube_dl\YoutubeDL.py", line 793, in extract_info File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp5g6wx9_e\build\youtube_dl\extractor\common.py", line 508, in extract File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp5g6wx9_e\build\youtube_dl\extractor\generic.py", line 3323, in _real_extract youtube_dl.utils.UnsupportedError: Unsupported URL: https://watch.diynetwork.com/tv-shows/building-off-the-grid/full-episodes/building-off-the-grid

@PlaceboPRS
Copy link

Is there an idiots guide anywhere on how to get/use cookies please? I have a cable account and would love to be able to download HGTV shows but haven't been possible since their format changed :(

@remitamine
Copy link
Collaborator

@PlaceboPRS
Copy link

https://github.com/ytdl-org/youtube-dl#how-do-i-pass-cookies-to-youtube-dl

Yes I've read that previously thanks and when I tried it didn't work for me, hence asking for an idiots guide as obviously I'm an idiot if others can get HGTV working and I can't.

@remitamine
Copy link
Collaborator

the process is as simple as it's been explained in the mentioned link, export cookies with a supported extension and pass them to youtube-dl with --cookies option, if that didn't work then you can start by providing more information about the error you're getting(verbose log and used cookie file with values changed).

@PlaceboPRS
Copy link

the process is as simple as it's been explained in the mentioned link, export cookies with a supported extension and pass them to youtube-dl with --cookies option, if that didn't work then you can start by providing more information about the error you're getting(verbose log and used cookie file with values changed).

You're absolutely right it's as simple as that, I must have screwed my cookies path or something, worked perfectly just now! So happy thanks :)

@ghost
Copy link

ghost commented Apr 21, 2019

Am using the cookies method fine, but its a bit tedious as you have to renew it pretty much every hour or so. Is there anyway to automate it a bit more, been looking at the discovery extractor but not been able to find a ways to get it to refresh and get the new cookies.

@PlaceboPRS
Copy link

PlaceboPRS commented Apr 21, 2019

Am using the cookies method fine, but its a bit tedious as you have to renew it pretty much every hour or so. Is there anyway to automate it a bit more, been looking at the discovery extractor but not been able to find a ways to get it to refresh and get the new cookies.

Another option is to use a browser user agent addon to change to something like Android or ipad and depending on which provider you're trying to use they may give you simpler URLs, this works with some of the sites I've been having problems with and for at least one of them I don't need to go down the cookie file path with the URLs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

9 participants