-
Notifications
You must be signed in to change notification settings - Fork 10.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
【FranceTV】Download no longer possible #29956
Comments
Même problème. |
I confirm this issue with FranceTV site. Specific code for extractor is in To download JSON metadata, extractor requests With datas used for tests in FranceTV extractor (line 51) : request for https://sivideo.webservices.francetelevisions.fr/tools/getInfosOeuvre/v2/?idDiffusion=162311093 => JSON message After a few debug, I didn't find the new URL/service in my HTTP logs to get metadatas via API. |
Here is quick early patch I wrote that seems to repair quite a few links. |
Thank you @sarnoud ! So is there an on-the-ground solution for end users with little or no programming expertise to apply this patch? If yes could you provide some guidance on the steps? Thank you. Warm regards, |
In your Python directory (i.e. /usr/lib/python3/dist-packages for Linux) enter the following command:
Et voilà :-) |
Thanks, so what if I'm using Windows 10 and not Linux? (Plus I see 2 directories on my machine with Win10:
Finally I've had to resort to busybox.exe to run Linux commands on my Win10 OS, but that wouldn't bring the physical directory /usr/lib/python3/dist-packages in place. Should I place the .txt patch file under the directory "C:\Users\DELL\AppData\Local\Programs\Python\Python39\lib\site-packages" as shown below? and what's next? Not sure what would be the correct way to proceed, sorry for my ignorance of Git.
Any guidance/instructions will be much appreciated. Thanks again, |
Hello I'm an Ubuntu 18.04 user. I have no youtube_dl directory in my /usr/lib/python3 directory (even in python3.6/3.7/3.8). |
Hello @guy-teube , your local youtube-dl installation should be in The file to patch is |
Hello @NiesmialyGosc, below I upload the complete Hope that helps. |
Sorry I don't understand. I'm not an professional IT guy and I can't understand some technical terms such as "patched with" & "youtube-dl local installation". Is youtube-dl intended for users with IT development knowledge (e.g. python) only? Could anyone please help to translate the above into an on-the-ground language without me as a normal user that wishes to watch online videos having to learn python grammar & vocabulary from scratch? Thank you for your patience & time, |
@NiesmialyGosc, are you on a Windows or a linux Machine ? [En français, au cas où : recherche un fichier qui s'appelle "francetv.py" sur ton PC et remplace-le par le patch en supprimant au préalable l'extension *.txt du patch] On a linux terminal, I wrote this :
and I changed the file. Unfortunately, this patch doesnot works (on my machine) : it downloads only a video file ; actually, there is neither sound nor subtitle. I have the same problem with Youtube-DLG. [En français, comme précisé ci-dessus en anglais, ce patch ne me récupère que le flux video - pas le flux audio ni le sous-titrage - je suis sous Ubuntu 20.04] |
Patch works. Thanks. Need to download video and audio separately : youtube-dl -i -f "bestvideo,bestaudio" https://www.france.tv/france-3/carnets-de-vol/2783631-emission-du-samedi-11-septembre-2021.html Merging video and audio : ffmpeg -i Carnets\ de\ vol-a386d839-8337-4975-bc98-767299aafb82.mp4 -i Carnets\ de\ vol-a386d839-8337-4975-bc98-767299aafb82.m4a -c copy -map 0:0 -map 1:0 Carnets\ de\ vol.mp4 |
Yes, it is ! I works.
|
Yes, FranceTV have separate streams for audio and video. If you have ffmpeg installed, by default
I confirm that with @sarnoud patch, subtitles are not supported. |
Ok thank you. Sadly I have nothing like this in /usr/local/lib/python3.6/dist-packages.
|
Thank you both team for the support! This is greatly appreciated & your tips really useful for future reference. THANK U. Can we have the subtitles downloaded as well? I actually had to resort to "Lj video downloader" for the video download, and the only & key issue is actually with the subtitles for which I had to use the yt-dlp downloader:
However, the generated subtitle file is in a mess which looks like this:
As a result, I have to remove those tags & recode the encoding which would take a lot of work.. Is there a better way to generate the subtitles than using the yt-dlp tool??? Or could any of you provide some tips on how to mass download, merge & reformat the webvtt files from France.TV, or a quick fix to remove the tags above? (If possible & if you could elaborate each step in detail, that'll be great) Thanks & Regards |
@guy-teube Try : locate "francetv.py" or find . -name "francetv.py" For me (Arch Linux) : /usr/lib/python3.7/site-packages/youtube_dl/extractor/francetv.py.0 |
I can't seem to edit the srt file generated with the aforementioned method by using Subtitle Edit 3.6.2 for I see the start time & end time of each frame are distorted in Subtitle Edit.. Any thoughts? |
To get subtitles for: The manifest.mpd is: In Firefox (any browser) replace manifest.mpd with textstream_fre=1000.webvtt and save file as vtt |
Works like a charm in my Chrome too, THANKS @Toto2u :) !! This is cool. And THANKS to the whole team for your continuous support and time in getting this resolved (I'm really looking forward to the next release of youtube-dl.exe soon though, lol) !! |
I have searched in / and found it only in my backup directory, in /usr/lib/python3/dist-packages/youtube_dl/, in 2019-10-20. I haven't this directory since this date, si youtube-dl is working without it since this day. |
@Toto2u, how did you get the manifest.mpd, please ? |
@D84web Open the console (F12) then Network tab. When the video is launched, make a search "manifest" (under this Network tab), and you will get this url. |
Not totally fixed yet, because the patch only retrieves MPD manifests, but the videos were also available as M3U8 playlists (with audio and video combined in one MP4 file), and some of them (like Murdoch Mysteries/Les enquêtes de Murdoch) are only available as M3U8 playlists, and this early patch is not working with these videos (“Error: No video formats found”). Hopefully, a new version of the patch will be made and will fix that, too. |
Some protected videos ? For this link : https://www.france.tv/france-3/les-enquetes-de-murdoch/saison-2/2743931-l-eventreur-de-toronto.html contains : "drm":true,"drm_type":"widevine" |
How I download the files:
Same result with audio track -1. |
Let yt-dlp do the work as I did: just specify the format and the page URL. No idea why that worked and yours didn't: maybe some parameters expire between getting the stream URL and running the download. That might also explain why the normal sequence of operations (get format URLs from page, download video, download audio, merge) fails. |
This is what I've done yesterday:
I see the size of the mp4.part file grow, until ~ 27 Mib, then when the download reaches 100%, I see the "fixing malformed AAC bitstream" message, and the size of the file goes down to 5 MiB. |
ffmpeg version? |
ffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers (the latest stable in ubuntu 18.04 aka Bionic Beaver) |
2.8 in 16.04 :-( Maybe: |
I've just updated my system tu 20.04 version, and the audio track is good now. Thank you for your help. |
@TiA4f8R Not working for Les enquêtes de Morse S8E3 - Terminus today, whether with Boring… And I know that the video is available, because I’ll give a try for week 4, if any… EDIT: and it worked with Boring… |
It's working fine for me with the patch !
Thanks @sarnoud ! |
Any news on this for a Windows user?
|
@Bocio First, try with a non-mobile URL (https://www.france.tv/france-2/mediterranee-l-odyssee-pour-la-vie/3257512-les-aventuriers-de-la-mediterranee.html). |
Sorry to up this issue, but is this trick not working anymore? @AudricV (TiA4f8R’s new nick?) I wanted to download the second aired episode of Les enquêtes de Vera (Vera), but it’s under DRM and when I get the
It seems that it replaces the domain in the URL to break the request. I fear that I can not download DRM videos anymore with this method:
|
Yeah, the trick doesn't work any more and it used to be much easier obtaining the complete file instead of downloading vid/audio separately as I've been doing for months. |
yt-dlp finds manifests but they are 403 from the UK, regardless of |
I confirm, issue is still: No video formats found |
@amigainc Which url? I just run some yt-dlp downloads on France TV, it works as usually. Maybe a temp problem on a specific video (France TV teams put sometimes wrongs links on the website...). |
This one, for example: https://www.france.tv/france-3/les-poules/5066034-les-poules-au-supermarche.html I succesfully downloaded it using Streamlink on Windows. |
It works well with yt-dlp 2023.06.22:
|
From the UK with 2023.03.04, the AV media all give 403 and only spritesheets are available. The extractor code is the same according to |
Can confirm this on latest yt-dlp -vF "https://www.france.tv/france-3/les-poules/5066034-les-poules-au-supermarche.html" =>
debug] Command-line config: ['--ffmpeg-location', '..\\FFmpeg', '--downloader-args', 'ffmpeg:-v 8 -stats', '-vF', 'https://www.france.tv/france-3/les-poules/5066034-les-poules-au-supermarche.html']
[debug] Encodings: locale cp1253, fs utf-8, pref cp1253, out utf-8 (No VT), error utf-8 (No VT), screen utf-8 (No VT)
[debug] yt-dlp version [email protected] [8776349ef] (win_x86_exe)
[debug] Python 3.7.9 (CPython x86 32bit) - Windows-Vista-6.0.6003-SP2 (OpenSSL 1.1.1g 21 Apr 2020)
[debug] exe versions: ffmpeg n6.1-dev-1397-N-111281-g285c7f6 (setts), ffprobe n6.1-dev-1397-N-111281-g285c7f6, phantomjs 2.1.1, rtmpdump 2.4
[debug] Optional libraries: Cryptodome-3.18.0, brotli-1.0.9, certifi-2023.05.07, mutagen-1.46.0, sqlite3-2.6.0, websockets-11.0.3
[debug] Proxy map: {}
[debug] Loaded 1856 extractors
[FranceTVSite] Extracting URL: https://www.france.tv/france-3/les-poules/5066034-les-poules-au-supermarche.html
[FranceTVSite] 5066034-les-poules-au-supermarche: Downloading webpage
[FranceTV] Extracting URL: francetv:bb637040-1729-11ee-9664-85e1f187131f
[FranceTV] bb637040-1729-11ee-9664-85e1f187131f: Downloading desktop video JSON
[FranceTV] bb637040-1729-11ee-9664-85e1f187131f: Downloading mobile video JSON
[FranceTV] bb637040-1729-11ee-9664-85e1f187131f: Downloading signed dash manifest URL
[FranceTV] bb637040-1729-11ee-9664-85e1f187131f: Downloading MPD manifest
[FranceTV] bb637040-1729-11ee-9664-85e1f187131f: Downloading signed hls manifest URL
[FranceTV] bb637040-1729-11ee-9664-85e1f187131f: Downloading m3u8 information
[debug] Formats sorted by: hasvid, ie_pref, lang, quality, res, fps, hdr:12(7), vcodec:vp9.2(10), channels, acodec, size, br, asr, proto, vext, aext, hasaud, source, id
[info] Available formats for bb637040-1729-11ee-9664-85e1f187131f:
ID EXT RESOLUTION FPS | FILESIZE TBR PROTO | VCODEC VBR ACODEC ABR ASR MORE INFO
-----------------------------------------------------------------------------------------------------------------------------------------------
spritesheets mhtml unknown | mhtml | images storyboard
hls-audio-aacl-96-Audio_Fran?ais mp4 audio only | m3u8 | audio only unknown [fr] Audio Fran?ais
dash-audio_fre=96000 m4a audio only | ~144.00KiB 96k dash | audio only mp4a.40.2 96k 48k [fr] DASH audio, m4a_dash
dash-video=400000 mp4 384x216 25 | ~600.00KiB 400k dash | avc1.42C01E 400k video only DASH video, mp4_dash
hls-521 mp4 384x216 25 | ~781.50KiB 521k m3u8 | avc1.42C01E 521k video only
dash-video=950000 mp4 640x360 25 | ~ 1.39MiB 950k dash | avc1.4D401F 950k video only DASH video, mp4_dash
hls-1104 mp4 640x360 25 | ~ 1.62MiB 1104k m3u8 | avc1.4D401F 1104k video only
dash-video=1400000 mp4 960x540 25 | ~ 2.05MiB 1400k dash | avc1.4D401F 1400k video only DASH video, mp4_dash
hls-1581 mp4 960x540 25 | ~ 2.32MiB 1581k m3u8 | avc1.4D401F 1581k video only
dash-video=2000000 mp4 1280x720 25 | ~ 2.93MiB 2000k dash | avc1.64001F 2000k video only DASH video, mp4_dash
hls-2217 mp4 1280x720 25 | ~ 3.25MiB 2217k m3u8 | avc1.64001F 2217k video only
dash-video=5000000 mp4 1920x1080 25 | ~ 7.32MiB 5000k dash | avc1.640029 5000k video only DASH video, mp4_dash
hls-5397 mp4 1920x1080 25 | ~ 7.91MiB 5397k m3u8 | avc1.640029 5397k video only Be that as it may, this is still the yt-dl -vF "https://www.france.tv/france-3/les-poules/5066034-les-poules-au-supermarche.html" =>
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--ffmpeg-location', '.\\FFmpeg', '--external-downloader-args', '-v 8 -stats', '-vF', 'https://www.france.tv/france-3/les-poules/5066034-les-poules-au-supermarche.html']
[debug] Encodings: locale cp1253, fs mbcs, out cp737, pref cp1253
[debug] youtube-dl version 2023.07.02.19419 (single file build)
[debug] Python 3.4.4 (CPython x86 32bit) - Windows-Vista-6.0.6003-SP2 - OpenSSL 1.0.2d 9 Jul 2015
[debug] exe versions: ffmpeg n6.1-dev-1397-N-111281-g285c7f6, ffprobe n6.1-dev-1397-N-111281-g285c7f6, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {}
[FranceTVSite] 5066034-les-poules-au-supermarche: Downloading webpage
[FranceTV] bb637040-1729-11ee-9664-85e1f187131f: Downloading video JSON
ERROR: Unable to download JSON metadata: <urlopen error [Errno 11001] getaddrinfo failed> (caused by URLError(gaierror(11001, 'getaddrinfo failed'),))
File "common.py", line 635, in _request_webpage
File "YoutubeDL.py", line 2356, in urlopen
File "C:\hostedtoolcache\windows\Python\3.4.4\x86\lib\urllib\request.py", line 464, in open
File "C:\hostedtoolcache\windows\Python\3.4.4\x86\lib\urllib\request.py", line 482, in _open
File "C:\hostedtoolcache\windows\Python\3.4.4\x86\lib\urllib\request.py", line 442, in _call_chain
File "D:\a\youtube-dl\youtube-dl\youtube_dl\utils.py", line 2791, in https_open
File "C:\hostedtoolcache\windows\Python\3.4.4\x86\lib\urllib\request.py", line 1185, in do_open (test above performed under the same French VPN...). |
Useful info for a future back-port/update. |
Checklist
Verbose log
Description
Hi team,
I can't seem to download any more video from FRANCE.TV, here are some examples:
https://www.france.tv/france-3/plus-belle-la-vie/plus-belle-la-vie-saison-18/2743611-episode-du-lundi-13-septembre-2021.html
https://www.france.tv/france-2/amour-gloire-et-beaute/2743793-emission-du-lundi-13-septembre-2021.html
https://www.france.tv/france-5/la-quotidienne/la-quotidienne-saison-9/2743883-emission-du-lundi-13-septembre-2021.html
I assure you it has nothing to do with any of my VPNs for I have verified these videos play like a charm in the browser with my VPNs turned on.
Could you please look into this FRANCE.TV issue on priority and help to publish the latest version ASAP?
Many Thanks!!
NiesmialyGosc
The text was updated successfully, but these errors were encountered: