s3: Max retries exceeded with url

[adegtyarev]

Uploading to s3 bucket in eu-west-1 region fails with:

2014-10-05 17:03:47,171 - Thread-9 - botocore.retryhandler - DEBUG - retry needed, retryable exception
caught: HTTPSConnectionPool(host='s3-eu-west-1.amazonaws.com', port=443): Max retries exceeded
with url: /hostname.backup/data.20141005.tar.gz.aes256?
partNumber=6&uploadId=UIqmKD4klVEuOzrZHaWolQ4vywXONM7iF4E_HIV0WvMlleEAaiQDchGTWG.wD5eLmHd3LDJCXfNm_7qC69iGoIcbOo36EoRsG.ONMHsXZcrSHGFMG6N3MzNpncvjkUgp 
(Caused by <class 'socket.error'>: [Errno 104] Connection reset by peer)
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/lib/python2.7/dist-packages/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='s3-eu-west-1.amazonaws.com', port=443): 
Max retries exceeded with url: /hostname.backup/data.20141005.tar.gz.aes256?
partNumber=6&uploadId=UIqmKD4klVEuOzrZHaWolQ4vywXONM7iF4E_HIV0WvMlleEAaiQDchGTWG.wD5eLmHd3LDJCXfNm_7qC69iGoIcbOo36EoRsG.ONMHsXZcrSHGFMG6N3MzNpncvjkUgp 
(Caused by <class 'socket.error'>: [Errno 104] Connection reset by peer)

Upload to default US region works fine from the same host.

CLI version: aws-cli/1.4.4 Python/2.7.6 Linux/3.13.0-36-generic, botocore version: 0.63.0

[jamesls]

The "Max retries exceeded with url:..." part is confusing. That's actually an error message from the HTTP library we use (requests). We catch that exception and do our own retry logic. The first line from the botocore.retryhandler logic shows this:

2014-10-05 17:03:47,171 - Thread-9 - botocore.retryhandler - DEBUG - retry needed, retryable exception

Is the overall operation failing? The CLI should be trying up to 5 times per each of those parts. If it is failing, could you post the complete --debug log? Thanks.

[adegtyarev]

The operation seems to be succeed (I can see uploaded file on S3) except that aws tells that upload failed.

Debug log: https://www.dropbox.com/s/kwpkq2m1e0if5jp/debug.log.gz?dl=0

BTW,
"DEBUG - Not changing URI, bucket is not DNS compatible: ru.hostname.backup.eu" - why it is not DNS compatible?

[jamesls]

Consolidating issues. Tracking this issue over here: #1092 which allows for a customer to modify the number of retries.