请教批量下载时非常容易报错怎么解决，不知道是不是网络问题

[cxyax]

问题：

一、报错问题

我使用这个命令进行下载
yutto -b https://www.bilibili.com/cheese/play/ss7341 -c SESSDATA -d /Users/****/Downloads/b站视频
有时会下载1-2个就会报错，有时候下载十几个报错，反正没有一直在下载，SESSDATA没变，clash关掉了，没有开

二、是否支持多线程批量下载

可不可以多线程下载，这样下载还是太慢

三、能否支持进度中断后，下次直接从中断处开始下载的模式

现在的问题是如果每次断掉，每次都要从头重新扫一下，大大拖慢了进度，能不能增加一种状态模式，然后下载的时候可以从上一次中断处开始下载

问题一 的报错内容

[176/555]  урок164走遍俄罗斯1-8-3
 INFO  开始处理视频 урок164走遍俄罗斯1-8-3
 INFO  共包含以下 6 个视频流：
 INFO  * 0 [AVC ] [3840x2160] < 4K 超清  > #3
 INFO    1 [AVC ] [1920x1080] <1080P 高码率> #3
 INFO    2 [AVC ] [1920x1080] <1080P 高清> #3
 INFO    3 [AVC ] [1280x720 ] <720P 高清 > #3
 INFO    4 [AVC ] [ 852x480 ] <480P 清晰 > #3
 INFO    5 [AVC ] [ 640x360 ] <360P 流畅 > #3
 INFO  共包含以下 3 个音频流：
 INFO  * 0 [MP4A] <320kbps >
 INFO    1 [MP4A] < 64kbps >
 INFO    2 [MP4A] <128kbps >
 字幕  中文（自动生成） 字幕已全部生成
 弹幕  ASS 弹幕已生成
 INFO  开始下载……
Traceback (most recent call last):━━━━━━━━━━━━━━━━  84.43 MiB/404.22 MiB 9.45 MiB/⚡    
  File "/opt/homebrew/bin/yutto", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/yutto/__main__.py", line 67, in main
    run(args_list)
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/yutto/utils/funcutils/as_sync.py", line 37, in sync_func
    return asyncio.run(async_func(*args, **kwargs))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/[email protected]/3.12.5/Frameworks/Python.framework/Versions/3.12/lib/python3.12/asyncio/runners.py", line 194, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/[email protected]/3.12.5/Frameworks/Python.framework/Versions/3.12/lib/python3.12/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/[email protected]/3.12.5/Frameworks/Python.framework/Versions/3.12/lib/python3.12/asyncio/base_events.py", line 687, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/yutto/__main__.py", line 344, in run
    current_download_state = await start_downloader(
                             ^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/yutto/processor/downloader.py", line 367, in start_downloader
    await download_video_and_audio(client, video, video_path, audio, audio_path, options)
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/yutto/processor/downloader.py", line 164, in download_video_and_audio
    await asyncio.gather(*coroutines)
  File "/opt/homebrew/Cellar/[email protected]/3.12.5/Frameworks/Python.framework/Versions/3.12/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable
    return await awaitable
           ^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/yutto/utils/asynclib.py", line 27, in __await__
    return (yield from self.coro.__await__())
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/yutto/utils/fetcher.py", line 214, in download_file_with_offset
    async with client.stream(
  File "/opt/homebrew/Cellar/[email protected]/3.12.5/Frameworks/Python.framework/Versions/3.12/lib/python3.12/contextlib.py", line 210, in __aenter__
    return await anext(self.gen)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpx/_client.py", line 1617, in stream
    response = await self.send(
               ^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpx/_client.py", line 1661, in send
    response = await self._send_handling_auth(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpx/_client.py", line 1689, in _send_handling_auth
    response = await self._send_handling_redirects(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpx/_client.py", line 1726, in _send_handling_redirects
    response = await self._send_single_request(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpx/_client.py", line 1763, in _send_single_request
    response = await transport.handle_async_request(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpx/_transports/default.py", line 373, in handle_async_request
    resp = await self._pool.handle_async_request(req)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpcore/_async/connection_pool.py", line 216, in handle_async_request
    raise exc from None
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpcore/_async/connection_pool.py", line 196, in handle_async_request
    response = await connection.handle_async_request(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpcore/_async/connection.py", line 99, in handle_async_request
    raise exc
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpcore/_async/connection.py", line 76, in handle_async_request
    stream = await self._connect(request)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpcore/_async/connection.py", line 154, in _connect
    stream = await stream.start_tls(**kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpcore/_backends/anyio.py", line 80, in start_tls
    raise exc
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/httpcore/_backends/anyio.py", line 71, in start_tls
    ssl_stream = await anyio.streams.tls.TLSStream.wrap(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/anyio/streams/tls.py", line 132, in wrap
    await wrapper._call_sslobject_method(ssl_object.do_handshake)
  File "/opt/homebrew/Cellar/yutto/2.0.0b40/libexec/lib/python3.12/site-packages/anyio/streams/tls.py", line 140, in _call_sslobject_method
    result = func(*args)
             ^^^^^^^^^^^
  File "/opt/homebrew/Cellar/[email protected]/3.12.5/Frameworks/Python.framework/Versions/3.12/lib/python3.12/ssl.py", line 917, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1000)

[Aqua256]

httpx里的tls模式关掉有助于解决问题吗

[Aqua256]

我也遇到了这个问题，我是这样做的

[SigureMo]

这个我可以直接改一下，之前使用 aiohttp 的时候有关过，迁移到 httpx 后没发现问题就暂时没关

[univerioiln233]

问题一，[Aqua256]的回答有用。

 WARN  抓取超时，正在重试，剩余 2 次
 WARN  抓取超时，正在重试，剩余 1 次
 WARN  抓取失败（ConnectError），正在重试，剩余 0 次
Traceback (most recent call last):
  File "C:\Users\\anaconda3\lib\runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "C:\Users\\anaconda3\lib\runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "C:\Users\\anaconda3\Scripts\yutto.exe\__main__.py", line 7, in <module>
  File "C:\Users\\anaconda3\lib\site-packages\yutto\__main__.py", line 72, in main
    run(args_list)
  File "C:\Users\\anaconda3\lib\site-packages\yutto\utils\funcutils\as_sync.py", line 39, in sync_func
    return asyncio.run(async_func(*args, **kwargs))
  File "C:\Users\\anaconda3\lib\asyncio\runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "C:\Users\\anaconda3\lib\asyncio\base_events.py", line 649, in run_until_complete
    return future.result()
  File "C:\Users\\anaconda3\lib\site-packages\yutto\__main__.py", line 352, in run
    current_download_state = await start_downloader(
  File "C:\Users\\anaconda3\lib\site-packages\yutto\processor\downloader.py", line 369, in start_downloader
    await download_video_and_audio(client, video, video_path, audio, audio_path, options)
  File "C:\Users\\anaconda3\lib\site-packages\yutto\processor\downloader.py", line 124, in download_video_and_audio
    vsize = await Fetcher.get_size(client, video["url"])
  File "C:\Users\\anaconda3\lib\site-packages\yutto\utils\fetcher.py", line 53, in connect_n_times
    raise MaxRetryError("超出最大重试次数！")
yutto.exceptions.MaxRetryError: 超出最大重试次数！

问题二，进度卡住。

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━  64.06 MiB/ 65.56 MiB 0.00 Bytes/s

[SigureMo]

参考 #271