Some YouTube videos fail to download with --write-annotations --ignore-errors

[ivan]

Checklist

• I'm reporting a broken site support issue
• I've verified that I'm running youtube-dl version 2019.06.08
• I've checked that all provided URLs are alive and playable in a browser
• I've checked that all URLs and arguments with special characters are properly quoted or escaped
• I've searched the bugtracker for similar bug reports including closed ones
• I've read bugs section in FAQ

Verbose log

# for i in \
"https://www.youtube.com/watch?v=aJMKGBjvxvw" \
"https://www.youtube.com/watch?v=LR1_jYAhSyo" \
"https://www.youtube.com/watch?v=PefN10IvaOk" \
"https://www.youtube.com/watch?v=iPUmE-tne5U" ; do
        echo $i
        PYTHONPATH=$HOME/code/archiving/youtube-dl python3 -m youtube_dl --verbose --write-annotations --ignore-errors "$i"
done

https://www.youtube.com/watch?v=aJMKGBjvxvw
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', '--write-annotations', '--ignore-errors', 'https://www.youtube.com/watch?v=aJMKGBjvxvw']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.06.08
[debug] Git HEAD: 7c24a58bd
[debug] Python version 3.7.3 (CPython) - Linux-4.19.52-hardened-x86_64-with-glibc2.2.5
[debug] exe versions: ffmpeg 4.1.3, ffprobe 4.1.3
[debug] Proxy map: {}
[youtube] aJMKGBjvxvw: Downloading webpage
[youtube] aJMKGBjvxvw: Downloading embed webpage
[youtube] aJMKGBjvxvw: Refetching age-gated info webpage
[youtube] {22} signature length 108, html5 player vfltBCqwT
[youtube] {43} signature length 108, html5 player vfltBCqwT
[youtube] {18} signature length 108, html5 player vfltBCqwT
[youtube] {137} signature length 108, html5 player vfltBCqwT
[youtube] {248} signature length 108, html5 player vfltBCqwT
[youtube] {136} signature length 108, html5 player vfltBCqwT
[youtube] {247} signature length 104, html5 player vfltBCqwT
[youtube] {135} signature length 108, html5 player vfltBCqwT
[youtube] {244} signature length 108, html5 player vfltBCqwT
[youtube] {134} signature length 104, html5 player vfltBCqwT
[youtube] {243} signature length 108, html5 player vfltBCqwT
[youtube] {133} signature length 104, html5 player vfltBCqwT
[youtube] {242} signature length 108, html5 player vfltBCqwT
[youtube] {160} signature length 108, html5 player vfltBCqwT
[youtube] {278} signature length 108, html5 player vfltBCqwT
[youtube] {140} signature length 108, html5 player vfltBCqwT
[youtube] {171} signature length 104, html5 player vfltBCqwT
[youtube] {249} signature length 104, html5 player vfltBCqwT
[youtube] {250} signature length 108, html5 player vfltBCqwT
[youtube] {251} signature length 104, html5 player vfltBCqwT
[youtube] aJMKGBjvxvw: Searching for annotations.
ERROR: Unable to download video annotations.: HTTP Error 404: Not Found (caused by <HTTPError 404: 'Not Found'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/home/at/code/archiving/youtube-dl/youtube_dl/extractor/common.py", line 627, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/home/at/code/archiving/youtube-dl/youtube_dl/YoutubeDL.py", line 2227, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 531, in open
    response = meth(req, response)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 569, in error
    return self._call_chain(*args)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 503, in _call_chain
    result = func(*args)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 649, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)

https://www.youtube.com/watch?v=LR1_jYAhSyo
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', '--write-annotations', '--ignore-errors', 'https://www.youtube.com/watch?v=LR1_jYAhSyo']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.06.08
[debug] Git HEAD: 7c24a58bd
[debug] Python version 3.7.3 (CPython) - Linux-4.19.52-hardened-x86_64-with-glibc2.2.5
[debug] exe versions: ffmpeg 4.1.3, ffprobe 4.1.3
[debug] Proxy map: {}
[youtube] LR1_jYAhSyo: Downloading webpage
[youtube] LR1_jYAhSyo: Downloading embed webpage
[youtube] LR1_jYAhSyo: Refetching age-gated info webpage
[youtube] LR1_jYAhSyo: Searching for annotations.
ERROR: Unable to download video annotations.: HTTP Error 404: Not Found (caused by <HTTPError 404: 'Not Found'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/home/at/code/archiving/youtube-dl/youtube_dl/extractor/common.py", line 627, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/home/at/code/archiving/youtube-dl/youtube_dl/YoutubeDL.py", line 2227, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 531, in open
    response = meth(req, response)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 569, in error
    return self._call_chain(*args)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 503, in _call_chain
    result = func(*args)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 649, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)

https://www.youtube.com/watch?v=PefN10IvaOk
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', '--write-annotations', '--ignore-errors', 'https://www.youtube.com/watch?v=PefN10IvaOk']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.06.08
[debug] Git HEAD: 7c24a58bd
[debug] Python version 3.7.3 (CPython) - Linux-4.19.52-hardened-x86_64-with-glibc2.2.5
[debug] exe versions: ffmpeg 4.1.3, ffprobe 4.1.3
[debug] Proxy map: {}
[youtube] PefN10IvaOk: Downloading webpage
[youtube] PefN10IvaOk: Downloading video info webpage
[youtube] PefN10IvaOk: Searching for annotations.
ERROR: Unable to download video annotations.: HTTP Error 404: Not Found (caused by <HTTPError 404: 'Not Found'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/home/at/code/archiving/youtube-dl/youtube_dl/extractor/common.py", line 627, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/home/at/code/archiving/youtube-dl/youtube_dl/YoutubeDL.py", line 2227, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 531, in open
    response = meth(req, response)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 569, in error
    return self._call_chain(*args)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 503, in _call_chain
    result = func(*args)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 649, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)

https://www.youtube.com/watch?v=iPUmE-tne5U
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', '--write-annotations', '--ignore-errors', 'https://www.youtube.com/watch?v=iPUmE-tne5U']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.06.08
[debug] Git HEAD: 7c24a58bd
[debug] Python version 3.7.3 (CPython) - Linux-4.19.52-hardened-x86_64-with-glibc2.2.5
[debug] exe versions: ffmpeg 4.1.3, ffprobe 4.1.3
[debug] Proxy map: {}
[youtube] iPUmE-tne5U: Downloading webpage
[youtube] iPUmE-tne5U: Downloading video info webpage
[youtube] {18} signature length 104, html5 player vfltBCqwT
[youtube] {135} signature length 108, html5 player vfltBCqwT
[youtube] {244} signature length 104, html5 player vfltBCqwT
[youtube] {397} signature length 108, html5 player vfltBCqwT
[youtube] {134} signature length 104, html5 player vfltBCqwT
[youtube] {243} signature length 108, html5 player vfltBCqwT
[youtube] {396} signature length 108, html5 player vfltBCqwT
[youtube] {133} signature length 108, html5 player vfltBCqwT
[youtube] {242} signature length 108, html5 player vfltBCqwT
[youtube] {395} signature length 108, html5 player vfltBCqwT
[youtube] {160} signature length 108, html5 player vfltBCqwT
[youtube] {278} signature length 108, html5 player vfltBCqwT
[youtube] {394} signature length 104, html5 player vfltBCqwT
[youtube] {140} signature length 104, html5 player vfltBCqwT
[youtube] {171} signature length 108, html5 player vfltBCqwT
[youtube] {249} signature length 108, html5 player vfltBCqwT
[youtube] {250} signature length 108, html5 player vfltBCqwT
[youtube] {251} signature length 108, html5 player vfltBCqwT
[youtube] iPUmE-tne5U: Searching for annotations.
ERROR: Unable to download video annotations.: HTTP Error 404: Not Found (caused by <HTTPError 404: 'Not Found'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/home/at/code/archiving/youtube-dl/youtube_dl/extractor/common.py", line 627, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/home/at/code/archiving/youtube-dl/youtube_dl/YoutubeDL.py", line 2227, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 531, in open
    response = meth(req, response)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 569, in error
    return self._call_chain(*args)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 503, in _call_chain
    result = func(*args)
  File "/nix/store/4c4ajgdnhlqk994hilagk5cgv7vw9yzg-python3-3.7.3/lib/python3.7/urllib/request.py", line 649, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)

Description

These videos exist and play, but fail to download with youtube-dl --write-annotations --ignore-errors:

• https://www.youtube.com/watch?v=aJMKGBjvxvw
• https://www.youtube.com/watch?v=LR1_jYAhSyo
• https://www.youtube.com/watch?v=PefN10IvaOk
• https://www.youtube.com/watch?v=qOHg-2ZtGl8 (not avail in US)
• https://www.youtube.com/watch?v=B6LhWbQthAI (not avail in US)
• https://www.youtube.com/watch?v=ZInRE-KryGA (not avail in US)
• https://www.youtube.com/watch?v=iPUmE-tne5U

[AshutoshSajan]

I am getting this error while downloading a video series.

ERROR: Unable to download webpage: HTTP Error 404: Not Found (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.