Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Getting Max retries exceeded with url #823

Closed
ErikEvenson opened this issue Jun 24, 2014 · 19 comments
Closed

Getting Max retries exceeded with url #823

ErikEvenson opened this issue Jun 24, 2014 · 19 comments
Labels
pr:work-in-progress This PR is a draft and needs further work.

Comments

@ErikEvenson
Copy link

Was uploading files earlier today with no problem, but getting the following error now:

HTTPSConnectionPool(host='s3-us-standard.amazonaws.com', port=443): Max retries exceeded with url: /vbenergyzone_staging?prefix=&encoding-type=url (Caused by <class 'socket.gaierror'>: [Errno -2] Name or service not known)

Using aws-cli/1.3.18 Python/2.7.7 Linux/3.2.0-23-generic.
@ErikEvenson
Copy link
Author

Here is a link to my debug trace: https://gist.github.com/ErikEvenson/ac3832e4063eb10248d7

@ErikEvenson ErikEvenson mentioned this issue Jun 24, 2014
Closed
@jamesls
Copy link
Member

jamesls commented Jun 24, 2014

What region are you using? From the debug logs it look like you're using us-standard, which is not a valid region. Try using a region of us-east-1.

@ErikEvenson
Copy link
Author

Thanks @jamesls -- that seems to have been the problem. Although I don't know what changed that required me to change that setting.

@lashex
Copy link

lashex commented Jul 6, 2014

I am still experiencing a very similar problem with the latest AWS CLI and large files that cross the multipart upload boundary.

brett@lilliput:~/.../ceremony $ aws s3 cp --region us-west-2 CDF_4251.NEF s3://kf-kauai/ceremony/CDF_4251.NEF --debug
2014-07-06 00:18:22,914 - awscli.clidriver - DEBUG - CLI version: aws-cli/1.3.11 Python/2.7.5 Darwin/13.2.0, botocore version: 0.45.0
2014-07-06 00:18:22,917 - botocore.service - DEBUG - Creating service object for: s3
2014-07-06 00:18:22,948 - botocore.hooks - DEBUG - Event service-data-loaded.s3: calling handler <function signature_overrides at 0x109705410>
2014-07-06 00:18:22,948 - botocore.hooks - DEBUG - Event service-created: calling handler <function register_retries_for_service at 0x109705230>
2014-07-06 00:18:22,948 - botocore.handlers - DEBUG - Registering retry handlers for service: Service(s3)
2014-07-06 00:18:22,949 - botocore.hooks - DEBUG - Event creating-endpoint.s3: calling handler <function maybe_switch_to_s3sigv4 at 0x109705320>
2014-07-06 00:18:22,949 - botocore.credentials - INFO - Found credentials in config file.
2014-07-06 00:18:22,988 - botocore.service - DEBUG - Creating service object for: s3
2014-07-06 00:18:22,989 - botocore.hooks - DEBUG - Event service-data-loaded.s3: calling handler <function signature_overrides at 0x109705410>
2014-07-06 00:18:22,989 - botocore.hooks - DEBUG - Event service-created: calling handler <function register_retries_for_service at 0x109705230>
2014-07-06 00:18:22,989 - botocore.handlers - DEBUG - Registering retry handlers for service: Service(s3)
2014-07-06 00:18:22,989 - awscli.customizations.s3.executor - DEBUG - Submitting task: <awscli.customizations.s3.tasks.CreateMultipartUploadTask object at 0x109c5f650>
2014-07-06 00:18:22,989 - awscli.customizations.s3.executor - DEBUG - Submitting task: <awscli.customizations.s3.tasks.UploadPartTask object at 0x109c5f850>
2014-07-06 00:18:22,989 - awscli.customizations.s3.executor - DEBUG - Worker thread invoking task: <awscli.customizations.s3.tasks.CreateMultipartUploadTask object at 0x109c5f650>
2014-07-06 00:18:22,990 - awscli.customizations.s3.executor - DEBUG - Submitting task: <awscli.customizations.s3.tasks.UploadPartTask object at 0x109c5f890>
2014-07-06 00:18:22,990 - awscli.customizations.s3.executor - DEBUG - Worker thread invoking task: <awscli.customizations.s3.tasks.UploadPartTask object at 0x109c5f850>
2014-07-06 00:18:22,990 - awscli.customizations.s3.tasks - DEBUG - Creating multipart upload for file: /Users/brett/Desktop/ceremony/CDF_4251.NEF
2014-07-06 00:18:22,990 - awscli.customizations.s3.executor - DEBUG - Submitting task: <awscli.customizations.s3.tasks.UploadPartTask object at 0x109c5f790>
2014-07-06 00:18:22,992 - botocore.service - DEBUG - Creating service object for: s3
2014-07-06 00:18:22,990 - awscli.customizations.s3.executor - DEBUG - Worker thread invoking task: <awscli.customizations.s3.tasks.UploadPartTask object at 0x109c5f890>
2014-07-06 00:18:22,992 - botocore.hooks - DEBUG - Event service-data-loaded.s3: calling handler <function signature_overrides at 0x109705410>
2014-07-06 00:18:22,992 - botocore.hooks - DEBUG - Event service-created: calling handler <function register_retries_for_service at 0x109705230>
2014-07-06 00:18:22,993 - botocore.handlers - DEBUG - Registering retry handlers for service: Service(s3)
2014-07-06 00:18:22,990 - awscli.customizations.s3.tasks - DEBUG - Uploading part 1 for filename: /Users/brett/Desktop/ceremony/CDF_4251.NEF
2014-07-06 00:18:22,992 - awscli.customizations.s3.executor - DEBUG - Worker thread invoking task: <awscli.customizations.s3.tasks.UploadPartTask object at 0x109c5f790>
2014-07-06 00:18:22,993 - awscli.customizations.s3.tasks - DEBUG - Uploading part 2 for filename: /Users/brett/Desktop/ceremony/CDF_4251.NEF
2014-07-06 00:18:22,993 - awscli.customizations.s3.executor - DEBUG - Submitting task: <awscli.customizations.s3.tasks.CompleteMultipartUploadTask object at 0x109c5f8d0>
2014-07-06 00:18:22,993 - awscli.customizations.s3.tasks - DEBUG - Waiting for upload id.
2014-07-06 00:18:22,993 - awscli.customizations.s3.tasks - DEBUG - Uploading part 3 for filename: /Users/brett/Desktop/ceremony/CDF_4251.NEF
2014-07-06 00:18:22,994 - awscli.customizations.s3.tasks - DEBUG - Waiting for upload id.
2014-07-06 00:18:22,995 - awscli.customizations.s3.executor - DEBUG - Queueing end sentinel for worker thread (priority: 11)
2014-07-06 00:18:22,995 - awscli.customizations.s3.tasks - DEBUG - Waiting for upload id.
2014-07-06 00:18:22,995 - awscli.customizations.s3.executor - DEBUG - Worker thread invoking task: <awscli.customizations.s3.tasks.CompleteMultipartUploadTask object at 0x109c5f8d0>
2014-07-06 00:18:22,996 - awscli.customizations.s3.executor - DEBUG - Queueing end sentinel for worker thread (priority: 11)
2014-07-06 00:18:22,996 - awscli.customizations.s3.tasks - DEBUG - Completing multipart upload for file: /Users/brett/Desktop/ceremony/CDF_4251.NEF
2014-07-06 00:18:22,996 - awscli.customizations.s3.executor - DEBUG - Queueing end sentinel for worker thread (priority: 11)
2014-07-06 00:18:22,996 - awscli.customizations.s3.executor - DEBUG - Shutdown request received in worker thread, shutting down worker thread.
2014-07-06 00:18:22,997 - awscli.customizations.s3.executor - DEBUG - Shutdown request received in worker thread, shutting down worker thread.
2014-07-06 00:18:22,997 - awscli.customizations.s3.executor - DEBUG - Queueing end sentinel for worker thread (priority: 11)
2014-07-06 00:18:22,997 - awscli.customizations.s3.executor - DEBUG - Shutdown request received in worker thread, shutting down worker thread.
2014-07-06 00:18:22,998 - awscli.customizations.s3.executor - DEBUG - Queueing end sentinel for worker thread (priority: 11)
2014-07-06 00:18:22,999 - awscli.customizations.s3.executor - DEBUG - Shutdown request received in worker thread, shutting down worker thread.
2014-07-06 00:18:22,999 - awscli.customizations.s3.executor - DEBUG - Queueing end sentinel for worker thread (priority: 11)
2014-07-06 00:18:22,999 - awscli.customizations.s3.executor - DEBUG - Shutdown request received in worker thread, shutting down worker thread.
2014-07-06 00:18:23,000 - awscli.customizations.s3.executor - DEBUG - Queueing end sentinel for worker thread (priority: 11)
2014-07-06 00:18:23,001 - awscli.customizations.s3.executor - DEBUG - Queueing end sentinel for worker thread (priority: 11)
2014-07-06 00:18:23,001 - awscli.customizations.s3.executor - DEBUG - Queueing end sentinel for worker thread (priority: 11)
2014-07-06 00:18:23,001 - awscli.customizations.s3.executor - DEBUG - Queueing end sentinel for worker thread (priority: 11)
2014-07-06 00:18:23,001 - awscli.customizations.s3.executor - DEBUG - Waiting for thread to shutdown: <Worker(Thread-3, started daemon 4490031104)>
2014-07-06 00:18:23,009 - botocore.service - DEBUG - Creating operation objects for: Service(s3)
2014-07-06 00:18:23,015 - botocore.operation - DEBUG - Operation:CreateMultipartUpload called with kwargs: {'bucket': u'kf-kauai', 'key': u'ceremony/CDF_4251.NEF'}
2014-07-06 00:18:23,015 - botocore.operation - DEBUG - Creating parameter objects for: Operation:CreateMultipartUpload
2014-07-06 00:18:23,021 - botocore.endpoint - DEBUG - Making request for Operation:CreateMultipartUpload (verify_ssl=True) with params: {'headers': {}, 'uri_params': {u'Bucket': u'kf-kauai', u'Key': u'ceremony/CDF_4251.NEF'}, 'payload': <botocore.payload.XMLPayload object at 0x109c82e10>}
2014-07-06 00:18:23,021 - botocore.endpoint - DEBUG - Building URI for rest endpoint.
2014-07-06 00:18:23,021 - botocore.endpoint - DEBUG - Templated URI path: /{Bucket}/{Key}
2014-07-06 00:18:23,021 - botocore.endpoint - DEBUG - Templated URI query_params: uploads
2014-07-06 00:18:23,022 - botocore.endpoint - DEBUG - Rendered path: /kf-kauai/ceremony/CDF_4251.NEF
2014-07-06 00:18:23,022 - botocore.endpoint - DEBUG - Rendered query_params: uploads
2014-07-06 00:18:23,022 - botocore.hooks - DEBUG - Event before-auth.s3: calling handler <function fix_s3_host at 0x109705140>
2014-07-06 00:18:23,022 - botocore.handlers - DEBUG - Checking for DNS compatible bucket for: https://s3-us-west-2.amazonaws.com/kf-kauai/ceremony/CDF_4251.NEF?uploads
2014-07-06 00:18:23,023 - botocore.handlers - DEBUG - URI updated to: https://kf-kauai.s3.amazonaws.com/ceremony/CDF_4251.NEF?uploads
2014-07-06 00:18:23,023 - botocore.auth - DEBUG - Calculating signature using hmacv1 auth.
2014-07-06 00:18:23,023 - botocore.auth - DEBUG - HTTP request method: POST
2014-07-06 00:18:23,023 - botocore.auth - DEBUG - StringToSign:
POST


Sun, 06 Jul 2014 07:18:23 GMT
/kf-kauai/ceremony/CDF_4251.NEF?uploads
2014-07-06 00:18:23,035 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [POST]>
2014-07-06 00:18:23,035 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (1): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:23,602 - botocore.vendored.requests.packages.urllib3.connectionpool - DEBUG - "POST /ceremony/CDF_4251.NEF?uploads HTTP/1.1" 307 None
2014-07-06 00:18:23,603 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (1): kf-kauai.s3-us-west-2.amazonaws.com
2014-07-06 00:18:24,264 - botocore.vendored.requests.packages.urllib3.connectionpool - DEBUG - "POST /ceremony/CDF_4251.NEF?uploads HTTP/1.1" 200 None
2014-07-06 00:18:24,265 - botocore.response - DEBUG - Response Headers:
x-amz-id-2: iK2EPfwQ+z6EqDwYggY1n6DCNJXKdNVrBeuFGOaOPYx79SZ/aEjo8ZvLCfJInB2s+yGyjSbVP3E=
date: Sun, 06 Jul 2014 07:18:25 GMT
transfer-encoding: chunked
x-amz-request-id: E089C4D9BECEC8BB
server: AmazonS3
2014-07-06 00:18:24,266 - botocore.response - DEBUG - Response Body:
<?xml version="1.0" encoding="UTF-8"?>
<InitiateMultipartUploadResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Bucket>kf-kauai</Bucket><Key>ceremony/CDF_4251.NEF</Key><UploadId>URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL</UploadId></InitiateMultipartUploadResult>
2014-07-06 00:18:24,266 - botocore.hooks - DEBUG - Event needs-retry.s3.CreateMultipartUpload: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:24,266 - botocore.retryhandler - DEBUG - No retry needed.
2014-07-06 00:18:24,266 - botocore.hooks - DEBUG - Event after-call.s3.CreateMultipartUpload: calling handler <awscli.errorhandler.ErrorHandler object at 0x109b25890>
2014-07-06 00:18:24,266 - awscli.errorhandler - DEBUG - HTTP Response Code: 200
2014-07-06 00:18:24,267 - awscli.customizations.s3.tasks - DEBUG - Announcing upload id: URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,267 - awscli.customizations.s3.executor - DEBUG - Shutdown request received in worker thread, shutting down worker thread.
2014-07-06 00:18:24,272 - awscli.customizations.s3.executor - DEBUG - Thread has been shutdown: <Worker(Thread-3, stopped daemon 4490031104)>
2014-07-06 00:18:24,273 - awscli.customizations.s3.executor - DEBUG - Waiting for thread to shutdown: <Worker(Thread-4, started daemon 4494237696)>
2014-07-06 00:18:24,315 - botocore.operation - DEBUG - Operation:UploadPart called with kwargs: {'body': <awscli.customizations.s3.utils.ReadFileChunk object at 0x109c5fb50>, 'upload_id': 'URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL', 'part_number': 3, 'bucket': u'kf-kauai', 'key': u'ceremony/CDF_4251.NEF'}
2014-07-06 00:18:24,316 - botocore.operation - DEBUG - Operation:UploadPart called with kwargs: {'body': <awscli.customizations.s3.utils.ReadFileChunk object at 0x109c5f650>, 'upload_id': 'URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL', 'part_number': 1, 'bucket': u'kf-kauai', 'key': u'ceremony/CDF_4251.NEF'}
2014-07-06 00:18:24,316 - botocore.operation - DEBUG - Creating parameter objects for: Operation:UploadPart
2014-07-06 00:18:24,316 - botocore.operation - DEBUG - Creating parameter objects for: Operation:UploadPart
2014-07-06 00:18:24,316 - botocore.operation - DEBUG - Operation:UploadPart called with kwargs: {'body': <awscli.customizations.s3.utils.ReadFileChunk object at 0x109b47e10>, 'upload_id': 'URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL', 'part_number': 2, 'bucket': u'kf-kauai', 'key': u'ceremony/CDF_4251.NEF'}
2014-07-06 00:18:24,317 - botocore.endpoint - DEBUG - Making request for Operation:UploadPart (verify_ssl=True) with params: {'headers': {}, 'uri_params': {u'UploadId': 'URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL', u'PartNumber': 3, u'Bucket': u'kf-kauai', u'Key': u'ceremony/CDF_4251.NEF'}, 'payload': <botocore.payload.Payload object at 0x109c5f690>}
2014-07-06 00:18:24,317 - botocore.endpoint - DEBUG - Making request for Operation:UploadPart (verify_ssl=True) with params: {'headers': {}, 'uri_params': {u'UploadId': 'URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL', u'PartNumber': 1, u'Bucket': u'kf-kauai', u'Key': u'ceremony/CDF_4251.NEF'}, 'payload': <botocore.payload.Payload object at 0x109c82e10>}
2014-07-06 00:18:24,318 - botocore.endpoint - DEBUG - Making request for Operation:UploadPart (verify_ssl=True) with params: {'headers': {}, 'uri_params': {u'UploadId': 'URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL', u'PartNumber': 2, u'Bucket': u'kf-kauai', u'Key': u'ceremony/CDF_4251.NEF'}, 'payload': <botocore.payload.Payload object at 0x109b47ed0>}
2014-07-06 00:18:24,318 - botocore.endpoint - DEBUG - Building URI for rest endpoint.
2014-07-06 00:18:24,318 - botocore.endpoint - DEBUG - Building URI for rest endpoint.
2014-07-06 00:18:24,318 - botocore.endpoint - DEBUG - Building URI for rest endpoint.
2014-07-06 00:18:24,318 - botocore.endpoint - DEBUG - Templated URI path: /{Bucket}/{Key}
2014-07-06 00:18:24,319 - botocore.endpoint - DEBUG - Templated URI path: /{Bucket}/{Key}
2014-07-06 00:18:24,319 - botocore.endpoint - DEBUG - Templated URI path: /{Bucket}/{Key}
2014-07-06 00:18:24,319 - botocore.endpoint - DEBUG - Templated URI query_params: partNumber={PartNumber}&uploadId={UploadId}
2014-07-06 00:18:24,319 - botocore.endpoint - DEBUG - Templated URI query_params: partNumber={PartNumber}&uploadId={UploadId}
2014-07-06 00:18:24,319 - botocore.endpoint - DEBUG - Templated URI query_params: partNumber={PartNumber}&uploadId={UploadId}
2014-07-06 00:18:24,319 - botocore.endpoint - DEBUG - Rendered path: /kf-kauai/ceremony/CDF_4251.NEF
2014-07-06 00:18:24,319 - botocore.endpoint - DEBUG - Rendered path: /kf-kauai/ceremony/CDF_4251.NEF
2014-07-06 00:18:24,320 - botocore.endpoint - DEBUG - Rendered path: /kf-kauai/ceremony/CDF_4251.NEF
2014-07-06 00:18:24,320 - botocore.endpoint - DEBUG - Rendered query_params: partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,320 - botocore.endpoint - DEBUG - Rendered query_params: partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,320 - botocore.endpoint - DEBUG - Rendered query_params: partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,320 - botocore.hooks - DEBUG - Event before-auth.s3: calling handler <function fix_s3_host at 0x109705140>
2014-07-06 00:18:24,321 - botocore.handlers - DEBUG - Checking for DNS compatible bucket for: https://s3-us-west-2.amazonaws.com/kf-kauai/ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,321 - botocore.handlers - DEBUG - URI updated to: https://kf-kauai.s3.amazonaws.com/ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,321 - botocore.auth - DEBUG - Calculating signature using hmacv1 auth.
2014-07-06 00:18:24,321 - botocore.auth - DEBUG - HTTP request method: PUT
2014-07-06 00:18:24,321 - botocore.auth - DEBUG - StringToSign:
PUT


Sun, 06 Jul 2014 07:18:24 GMT
/kf-kauai/ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,322 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:24,322 - botocore.hooks - DEBUG - Event before-auth.s3: calling handler <function fix_s3_host at 0x109705140>
2014-07-06 00:18:24,322 - botocore.handlers - DEBUG - Checking for DNS compatible bucket for: https://s3-us-west-2.amazonaws.com/kf-kauai/ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,323 - botocore.handlers - DEBUG - URI updated to: https://kf-kauai.s3.amazonaws.com/ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,323 - botocore.auth - DEBUG - Calculating signature using hmacv1 auth.
2014-07-06 00:18:24,323 - botocore.auth - DEBUG - HTTP request method: PUT
2014-07-06 00:18:24,323 - botocore.auth - DEBUG - StringToSign:
PUT


Sun, 06 Jul 2014 07:18:24 GMT
/kf-kauai/ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,324 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:24,324 - botocore.hooks - DEBUG - Event before-auth.s3: calling handler <function fix_s3_host at 0x109705140>
2014-07-06 00:18:24,324 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (2): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:24,325 - botocore.handlers - DEBUG - Checking for DNS compatible bucket for: https://s3-us-west-2.amazonaws.com/kf-kauai/ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,325 - botocore.handlers - DEBUG - URI updated to: https://kf-kauai.s3.amazonaws.com/ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,325 - botocore.auth - DEBUG - Calculating signature using hmacv1 auth.
2014-07-06 00:18:24,326 - botocore.auth - DEBUG - HTTP request method: PUT
2014-07-06 00:18:24,326 - botocore.auth - DEBUG - StringToSign:
PUT


Sun, 06 Jul 2014 07:18:24 GMT
/kf-kauai/ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:24,327 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:24,327 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (3): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:25,370 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:25,370 - botocore.retryhandler - DEBUG - retry needed, retryable exception caught: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:25,372 - botocore.retryhandler - DEBUG - Retry needed, action of: 0.286070933589
2014-07-06 00:18:25,372 - botocore.endpoint - DEBUG - Response received to retry, sleeping for 0.286070933589 seconds
2014-07-06 00:18:25,525 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:25,526 - botocore.retryhandler - DEBUG - retry needed, retryable exception caught: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:25,526 - botocore.retryhandler - DEBUG - Retry needed, action of: 0.688581613093
2014-07-06 00:18:25,526 - botocore.endpoint - DEBUG - Response received to retry, sleeping for 0.688581613093 seconds
2014-07-06 00:18:25,660 - botocore.awsrequest - DEBUG - Rewinding stream: <awscli.customizations.s3.utils.ReadFileChunk object at 0x109c5fb50>
2014-07-06 00:18:25,660 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:25,660 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (4): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:25,820 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:25,820 - botocore.retryhandler - DEBUG - retry needed, retryable exception caught: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:25,821 - botocore.retryhandler - DEBUG - Retry needed, action of: 0.652287385652
2014-07-06 00:18:25,821 - botocore.endpoint - DEBUG - Response received to retry, sleeping for 0.652287385652 seconds
2014-07-06 00:18:26,215 - botocore.awsrequest - DEBUG - Rewinding stream: <awscli.customizations.s3.utils.ReadFileChunk object at 0x109c5f650>
2014-07-06 00:18:26,215 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:26,215 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (5): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:26,474 - botocore.awsrequest - DEBUG - Rewinding stream: <awscli.customizations.s3.utils.ReadFileChunk object at 0x109b47e10>
2014-07-06 00:18:26,475 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:26,475 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (6): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:27,019 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:27,019 - botocore.retryhandler - DEBUG - retry needed, retryable exception caught: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:27,019 - botocore.retryhandler - DEBUG - Retry needed, action of: 0.163161111389
2014-07-06 00:18:27,019 - botocore.endpoint - DEBUG - Response received to retry, sleeping for 0.163161111389 seconds
2014-07-06 00:18:27,183 - botocore.awsrequest - DEBUG - Rewinding stream: <awscli.customizations.s3.utils.ReadFileChunk object at 0x109c5fb50>
2014-07-06 00:18:27,183 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:27,183 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (7): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:28,304 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:28,305 - botocore.retryhandler - DEBUG - retry needed, retryable exception caught: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:28,305 - botocore.retryhandler - DEBUG - Retry needed, action of: 1.69983225581
2014-07-06 00:18:28,305 - botocore.endpoint - DEBUG - Response received to retry, sleeping for 1.69983225581 seconds
2014-07-06 00:18:28,309 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:28,310 - botocore.retryhandler - DEBUG - retry needed, retryable exception caught: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:28,310 - botocore.retryhandler - DEBUG - Retry needed, action of: 1.65524771199
2014-07-06 00:18:28,310 - botocore.endpoint - DEBUG - Response received to retry, sleeping for 1.65524771199 seconds
2014-07-06 00:18:28,389 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:28,389 - botocore.retryhandler - DEBUG - retry needed, retryable exception caught: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:28,389 - botocore.retryhandler - DEBUG - Retry needed, action of: 3.64101289408
2014-07-06 00:18:28,389 - botocore.endpoint - DEBUG - Response received to retry, sleeping for 3.64101289408 seconds
2014-07-06 00:18:29,966 - botocore.awsrequest - DEBUG - Rewinding stream: <awscli.customizations.s3.utils.ReadFileChunk object at 0x109c5f650>
2014-07-06 00:18:29,967 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:29,967 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (8): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:30,006 - botocore.awsrequest - DEBUG - Rewinding stream: <awscli.customizations.s3.utils.ReadFileChunk object at 0x109b47e10>
2014-07-06 00:18:30,006 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:30,007 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (9): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:31,196 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:31,197 - botocore.retryhandler - DEBUG - retry needed, retryable exception caught: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:31,197 - botocore.retryhandler - DEBUG - Retry needed, action of: 0.0332870761572
2014-07-06 00:18:31,197 - botocore.endpoint - DEBUG - Response received to retry, sleeping for 0.0332870761572 seconds
2014-07-06 00:18:31,231 - botocore.awsrequest - DEBUG - Rewinding stream: <awscli.customizations.s3.utils.ReadFileChunk object at 0x109c5f650>
2014-07-06 00:18:31,231 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:31,232 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (10): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:31,447 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:31,447 - botocore.retryhandler - DEBUG - retry needed, retryable exception caught: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:31,447 - botocore.retryhandler - DEBUG - Retry needed, action of: 0.162854643858
2014-07-06 00:18:31,447 - botocore.endpoint - DEBUG - Response received to retry, sleeping for 0.162854643858 seconds
2014-07-06 00:18:31,611 - botocore.awsrequest - DEBUG - Rewinding stream: <awscli.customizations.s3.utils.ReadFileChunk object at 0x109b47e10>
2014-07-06 00:18:31,611 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:31,611 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (11): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:32,031 - botocore.awsrequest - DEBUG - Rewinding stream: <awscli.customizations.s3.utils.ReadFileChunk object at 0x109c5fb50>
2014-07-06 00:18:32,031 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:32,032 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (12): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:32,557 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:32,557 - botocore.retryhandler - DEBUG - retry needed, retryable exception caught: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:32,558 - botocore.retryhandler - DEBUG - Retry needed, action of: 1.7056551534
2014-07-06 00:18:32,558 - botocore.endpoint - DEBUG - Response received to retry, sleeping for 1.7056551534 seconds
2014-07-06 00:18:32,995 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:32,996 - botocore.retryhandler - DEBUG - retry needed, retryable exception caught: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:32,996 - botocore.retryhandler - DEBUG - Retry needed, action of: 0.936428217464
2014-07-06 00:18:32,996 - botocore.endpoint - DEBUG - Response received to retry, sleeping for 0.936428217464 seconds
2014-07-06 00:18:33,934 - botocore.awsrequest - DEBUG - Rewinding stream: <awscli.customizations.s3.utils.ReadFileChunk object at 0x109b47e10>
2014-07-06 00:18:33,934 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:33,934 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (13): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:34,265 - botocore.awsrequest - DEBUG - Rewinding stream: <awscli.customizations.s3.utils.ReadFileChunk object at 0x109c5f650>
2014-07-06 00:18:34,265 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:34,265 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (14): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:34,298 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:34,298 - botocore.retryhandler - DEBUG - retry needed, retryable exception caught: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 262, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:34,298 - botocore.retryhandler - DEBUG - Retry needed, action of: 0.254469192255
2014-07-06 00:18:34,298 - botocore.endpoint - DEBUG - Response received to retry, sleeping for 0.254469192255 seconds
2014-07-06 00:18:34,553 - botocore.awsrequest - DEBUG - Rewinding stream: <awscli.customizations.s3.utils.ReadFileChunk object at 0x109c5fb50>
2014-07-06 00:18:34,553 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [PUT]>
2014-07-06 00:18:34,553 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (15): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:35,212 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:35,212 - awscli.customizations.s3.tasks - DEBUG - Error during part upload: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/lib/python2.7/site-packages/awscli/customizations/s3/tasks.py", line 228, in __call__
    self._filename.service, 'UploadPart', params)
  File "/usr/local/Cellar/awscli/1.3.11/lib/python2.7/site-packages/awscli/customizations/s3/utils.py", line 153, in operate
    http_response, response_data = operation.call(**kwargs)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/operation.py", line 68, in call
    response = endpoint.make_request(self, params)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/endpoint.py", line 76, in make_request
    return self._send_request(prepared_request, operation)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/endpoint.py", line 98, in _send_request
    while self._needs_retry(attempts, operation, response, exception):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/endpoint.py", line 129, in _needs_retry
    caught_exception=caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/session.py", line 640, in emit_first_non_none_response
    responses = self._events.emit(event_name, **kwargs)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/hooks.py", line 150, in emit
    response = handler(**kwargs)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 180, in __call__
    if self._checker(attempts, response, caught_exception):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 247, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 270, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:35,217 - awscli.customizations.s3.executor - DEBUG - Shutdown request received in worker thread, shutting down worker thread.
2014-07-06 00:18:35,217 - awscli.customizations.s3.executor - DEBUG - Received print task: {'message': u"upload failed: ./CDF_4251.NEF to s3://kf-kauai/ceremony/CDF_4251.NEF\nHTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)", 'error': True}
upload failed: ./CDF_4251.NEF to s3://kf-kauai/ceremony/CDF_4251.NEF
HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=2&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:35,325 - awscli.customizations.s3.executor - DEBUG - Error calling task: Upload has been cancelled.
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/lib/python2.7/site-packages/awscli/customizations/s3/executor.py", line 192, in run
    function()
  File "/usr/local/Cellar/awscli/1.3.11/lib/python2.7/site-packages/awscli/customizations/s3/tasks.py", line 459, in __call__
    parts = self._upload_context.wait_for_parts_to_finish()
  File "/usr/local/Cellar/awscli/1.3.11/lib/python2.7/site-packages/awscli/customizations/s3/tasks.py", line 557, in wait_for_parts_to_finish
    raise UploadCancelledError("Upload has been cancelled.")
UploadCancelledError: Upload has been cancelled.
2014-07-06 00:18:35,326 - awscli.customizations.s3.executor - DEBUG - Shutdown request received in worker thread, shutting down worker thread.
2014-07-06 00:18:36,722 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:36,722 - awscli.customizations.s3.tasks - DEBUG - Error during part upload: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/lib/python2.7/site-packages/awscli/customizations/s3/tasks.py", line 228, in __call__
    self._filename.service, 'UploadPart', params)
  File "/usr/local/Cellar/awscli/1.3.11/lib/python2.7/site-packages/awscli/customizations/s3/utils.py", line 153, in operate
    http_response, response_data = operation.call(**kwargs)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/operation.py", line 68, in call
    response = endpoint.make_request(self, params)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/endpoint.py", line 76, in make_request
    return self._send_request(prepared_request, operation)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/endpoint.py", line 98, in _send_request
    while self._needs_retry(attempts, operation, response, exception):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/endpoint.py", line 129, in _needs_retry
    caught_exception=caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/session.py", line 640, in emit_first_non_none_response
    responses = self._events.emit(event_name, **kwargs)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/hooks.py", line 150, in emit
    response = handler(**kwargs)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 180, in __call__
    if self._checker(attempts, response, caught_exception):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 247, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 270, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:36,723 - awscli.customizations.s3.executor - DEBUG - Received print task: {'message': u"upload failed: ./CDF_4251.NEF to s3://kf-kauai/ceremony/CDF_4251.NEF\nHTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)", 'error': True}
upload failed: ./CDF_4251.NEF to s3://kf-kauai/ceremony/CDF_4251.NEF
HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=1&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:36,723 - awscli.customizations.s3.executor - DEBUG - Shutdown request received in worker thread, shutting down worker thread.
2014-07-06 00:18:36,745 - awscli.customizations.s3.executor - DEBUG - Thread has been shutdown: <Worker(Thread-4, stopped daemon 4494237696)>
2014-07-06 00:18:36,745 - awscli.customizations.s3.executor - DEBUG - Waiting for thread to shutdown: <Worker(Thread-5, stopped daemon 4498444288)>
2014-07-06 00:18:36,745 - awscli.customizations.s3.executor - DEBUG - Thread has been shutdown: <Worker(Thread-5, stopped daemon 4498444288)>
2014-07-06 00:18:36,745 - awscli.customizations.s3.executor - DEBUG - Waiting for thread to shutdown: <Worker(Thread-6, started daemon 4502650880)>
2014-07-06 00:18:36,850 - botocore.hooks - DEBUG - Event needs-retry.s3.UploadPart: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:36,851 - awscli.customizations.s3.tasks - DEBUG - Error during part upload: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
Traceback (most recent call last):
  File "/usr/local/Cellar/awscli/1.3.11/lib/python2.7/site-packages/awscli/customizations/s3/tasks.py", line 228, in __call__
    self._filename.service, 'UploadPart', params)
  File "/usr/local/Cellar/awscli/1.3.11/lib/python2.7/site-packages/awscli/customizations/s3/utils.py", line 153, in operate
    http_response, response_data = operation.call(**kwargs)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/operation.py", line 68, in call
    response = endpoint.make_request(self, params)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/endpoint.py", line 76, in make_request
    return self._send_request(prepared_request, operation)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/endpoint.py", line 98, in _send_request
    while self._needs_retry(attempts, operation, response, exception):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/endpoint.py", line 129, in _needs_retry
    caught_exception=caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/session.py", line 640, in emit_first_non_none_response
    responses = self._events.emit(event_name, **kwargs)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/hooks.py", line 150, in emit
    response = handler(**kwargs)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 180, in __call__
    if self._checker(attempts, response, caught_exception):
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 247, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 270, in _should_retry
    return self._checker(attempt_number, response, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 310, in __call__
    caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 219, in __call__
    return self._check_caught_exception(attempt_number, caught_exception)
  File "/usr/local/Cellar/awscli/1.3.11/libexec/lib/python2.7/site-packages/botocore-0.45.0-py2.7.egg/botocore/retryhandler.py", line 352, in _check_caught_exception
    raise caught_exception
ConnectionError: HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:36,851 - awscli.customizations.s3.executor - DEBUG - Shutdown request received in worker thread, shutting down worker thread.
2014-07-06 00:18:36,852 - awscli.customizations.s3.executor - DEBUG - Received print task: {'message': u"upload failed: ./CDF_4251.NEF to s3://kf-kauai/ceremony/CDF_4251.NEF\nHTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)", 'error': True}
upload failed: ./CDF_4251.NEF to s3://kf-kauai/ceremony/CDF_4251.NEF
HTTPSConnectionPool(host='kf-kauai.s3.amazonaws.com', port=443): Max retries exceeded with url: /ceremony/CDF_4251.NEF?partNumber=3&uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL (Caused by <class 'socket.error'>: [Errno 32] Broken pipe)
2014-07-06 00:18:36,860 - awscli.customizations.s3.executor - DEBUG - Thread has been shutdown: <Worker(Thread-6, stopped daemon 4502650880)>
2014-07-06 00:18:36,860 - awscli.customizations.s3.executor - DEBUG - Waiting for thread to shutdown: <Worker(Thread-7, stopped daemon 4506857472)>
2014-07-06 00:18:36,860 - awscli.customizations.s3.executor - DEBUG - Thread has been shutdown: <Worker(Thread-7, stopped daemon 4506857472)>
2014-07-06 00:18:36,860 - awscli.customizations.s3.executor - DEBUG - Waiting for thread to shutdown: <Worker(Thread-8, stopped daemon 4511064064)>
2014-07-06 00:18:36,860 - awscli.customizations.s3.executor - DEBUG - Thread has been shutdown: <Worker(Thread-8, stopped daemon 4511064064)>
2014-07-06 00:18:36,860 - awscli.customizations.s3.executor - DEBUG - Waiting for thread to shutdown: <Worker(Thread-9, stopped daemon 4515270656)>
2014-07-06 00:18:36,861 - awscli.customizations.s3.executor - DEBUG - Thread has been shutdown: <Worker(Thread-9, stopped daemon 4515270656)>
2014-07-06 00:18:36,861 - awscli.customizations.s3.executor - DEBUG - Waiting for thread to shutdown: <Worker(Thread-10, stopped daemon 4519477248)>
2014-07-06 00:18:36,861 - awscli.customizations.s3.executor - DEBUG - Thread has been shutdown: <Worker(Thread-10, stopped daemon 4519477248)>
2014-07-06 00:18:36,861 - awscli.customizations.s3.executor - DEBUG - Waiting for thread to shutdown: <Worker(Thread-11, stopped daemon 4523683840)>
2014-07-06 00:18:36,861 - awscli.customizations.s3.executor - DEBUG - Thread has been shutdown: <Worker(Thread-11, stopped daemon 4523683840)>
2014-07-06 00:18:36,861 - awscli.customizations.s3.executor - DEBUG - Waiting for thread to shutdown: <Worker(Thread-12, stopped daemon 4527890432)>
2014-07-06 00:18:36,861 - awscli.customizations.s3.executor - DEBUG - Thread has been shutdown: <Worker(Thread-12, stopped daemon 4527890432)>
2014-07-06 00:18:36,861 - awscli.customizations.s3.executor - DEBUG - Queueing end sentinel for result thread.
2014-07-06 00:18:36,861 - awscli.customizations.s3.executor - DEBUG - Queueing end sentinel for IO thread.

2014-07-06 00:18:36,862 - awscli.customizations.s3.executor - DEBUG - Waiting for result thread to shutdown.
2014-07-06 00:18:36,862 - awscli.customizations.s3.executor - DEBUG - Shutdown request received in print thread, shutting down print thread.
2014-07-06 00:18:36,862 - awscli.customizations.s3.executor - DEBUG - Shutdown request received in IO thread, shutting down.
2014-07-06 00:18:36,862 - awscli.customizations.s3.executor - DEBUG - Waiting for IO thread to shutdown.
2014-07-06 00:18:36,862 - awscli.customizations.s3.executor - DEBUG - All threads have been shutdown.
2014-07-06 00:18:36,862 - awscli.customizations.s3.s3handler - DEBUG - Aborting multipart upload for: ceremony/CDF_4251.NEF
2014-07-06 00:18:36,862 - botocore.operation - DEBUG - Operation:AbortMultipartUpload called with kwargs: {'bucket': u'kf-kauai', 'upload_id': 'URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL', 'key': u'ceremony/CDF_4251.NEF'}
2014-07-06 00:18:36,863 - botocore.operation - DEBUG - Creating parameter objects for: Operation:AbortMultipartUpload
2014-07-06 00:18:36,863 - botocore.endpoint - DEBUG - Making request for Operation:AbortMultipartUpload (verify_ssl=True) with params: {'headers': {}, 'uri_params': {u'UploadId': 'URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL', u'Bucket': u'kf-kauai', u'Key': u'ceremony/CDF_4251.NEF'}, 'payload': <botocore.payload.XMLPayload object at 0x109b47ed0>}
2014-07-06 00:18:36,863 - botocore.endpoint - DEBUG - Building URI for rest endpoint.
2014-07-06 00:18:36,863 - botocore.endpoint - DEBUG - Templated URI path: /{Bucket}/{Key}
2014-07-06 00:18:36,863 - botocore.endpoint - DEBUG - Templated URI query_params: uploadId={UploadId}
2014-07-06 00:18:36,863 - botocore.endpoint - DEBUG - Rendered path: /kf-kauai/ceremony/CDF_4251.NEF
2014-07-06 00:18:36,863 - botocore.endpoint - DEBUG - Rendered query_params: uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:36,864 - botocore.hooks - DEBUG - Event before-auth.s3: calling handler <function fix_s3_host at 0x109705140>
2014-07-06 00:18:36,864 - botocore.handlers - DEBUG - Checking for DNS compatible bucket for: https://s3-us-west-2.amazonaws.com/kf-kauai/ceremony/CDF_4251.NEF?uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:36,864 - botocore.handlers - DEBUG - URI updated to: https://kf-kauai.s3.amazonaws.com/ceremony/CDF_4251.NEF?uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:36,864 - botocore.auth - DEBUG - Calculating signature using hmacv1 auth.
2014-07-06 00:18:36,864 - botocore.auth - DEBUG - HTTP request method: DELETE
2014-07-06 00:18:36,864 - botocore.auth - DEBUG - StringToSign:
DELETE


Sun, 06 Jul 2014 07:18:36 GMT
/kf-kauai/ceremony/CDF_4251.NEF?uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL
2014-07-06 00:18:36,865 - botocore.endpoint - DEBUG - Sending http request: <PreparedRequest [DELETE]>
2014-07-06 00:18:36,865 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Starting new HTTPS connection (16): kf-kauai.s3.amazonaws.com
2014-07-06 00:18:37,376 - botocore.vendored.requests.packages.urllib3.connectionpool - DEBUG - "DELETE /ceremony/CDF_4251.NEF?uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL HTTP/1.1" 307 None
2014-07-06 00:18:37,377 - botocore.vendored.requests.packages.urllib3.connectionpool - INFO - Resetting dropped connection: kf-kauai.s3-us-west-2.amazonaws.com
2014-07-06 00:18:37,829 - botocore.vendored.requests.packages.urllib3.connectionpool - DEBUG - "DELETE /ceremony/CDF_4251.NEF?uploadId=URCXW7Io4IHyNnK8Pv718A9O.ghbkY9IOtIY81AJygFY9NwO2JsDXbM3EIWGR_ZJOy44QY6DqMfiKoT2q.igp8p_ubmF0SNE_XFeroeYZ73d1ZwtZ.d4za4q1s.DBfzL HTTP/1.1" 204 0
2014-07-06 00:18:37,830 - botocore.response - DEBUG - Response Headers:
x-amz-id-2: y1x+B2qKyP0iSuf/C6Fi7/IlGX8unmOmqWaBi5RTGD55FG0lqHPEfgoGStZdcc7GpV2bkXmPyw4=
date: Sun, 06 Jul 2014 07:18:38 GMT
x-amz-request-id: 0C7CC4E08EC6BFE0
server: AmazonS3
2014-07-06 00:18:37,830 - botocore.response - DEBUG - Response Body:

2014-07-06 00:18:37,830 - botocore.hooks - DEBUG - Event needs-retry.s3.AbortMultipartUpload: calling handler <botocore.retryhandler.RetryHandler object at 0x109b30f90>
2014-07-06 00:18:37,830 - botocore.retryhandler - DEBUG - No retry needed.
2014-07-06 00:18:37,830 - botocore.hooks - DEBUG - Event after-call.s3.AbortMultipartUpload: calling handler <awscli.errorhandler.ErrorHandler object at 0x109b25890>
2014-07-06 00:18:37,830 - awscli.errorhandler - DEBUG - HTTP Response Code: 204

@jamesls
Copy link
Member

jamesls commented Jul 7, 2014

Looks like you're using an old version of the CLI:

2014-07-06 00:18:22,914 - awscli.clidriver - DEBUG - CLI version: aws-cli/1.3.11 Python/2.7.5 Darwin/13.2.0, botocore version: 0.45.0

Could you try use the latest CLI version (1.3.21) and see if you still have this issue?

@lashex
Copy link

lashex commented Jul 8, 2014

It seems that AWS CLI in Homebrew has not been updated since 1.3.11
I've been running brew upgrade awscli and everything shows as up-to-date with 1.3.11.
When I uninstall using Homebrew and then install AWS CLI using pip install awscli I then get 1.3.21.
Following the successful upgrade of AWS CLI to 1.3.21 my file uploads no longer experience any errors.

@alexlenail
Copy link

I seem to be having a similar issue.

aws s3 ls

HTTPSConnectionPool(host='s3-us-standard.amazonaws.com', port=443): Max retries exceeded with url: / (Caused by <class 'socket.gaierror'>: [Errno -2] Name or service not known)

aws-cli/1.3.22 Python/2.7.3 Linux/3.2.0-61-generic

@jamesls
Copy link
Member

jamesls commented Jul 29, 2014

For the us standard region, use --region us-east-1.

@sudhirkk
Copy link

Looks like us-east-1 is not valid. I could use us-east-1a but was timing out as well.

I have the same issue for aws s3 ls commands.
$ aws s3 --region us-east-1a ls s3://data_abcd HTTPSConnectionPool(host='s3-us-east-1a.amazonaws.com', port=443): Max retries exceeded with url: /data_abcd?delimiter=/&prefix= (Caused by <class 'socket.gaierror'>: [Errno -2] Name or service not known)

The verstion I have is 1.3.21.
$ aws --version aws-cli/1.3.21 Python/2.6.9 Linux/3.10.48-55.140.amzn1.x86_64

@jamesls
Copy link
Member

jamesls commented Jul 29, 2014

Can you show the error for us-east-1? I just confirmed it works for me.

@sudhirkk
Copy link

This is what I get:
$ aws s3 --region us-east-1 ls s3://data_sk/

A client error (InvalidAccessKeyId) occurred when calling the ListObjects operation: The AWS Access Key Id you provided does not exist in our records.

@jamesls
Copy link
Member

jamesls commented Jul 29, 2014

Ah so that's a different error. That's saying that your credentials aren't valid. I'd double check to make sure you're credentials are correct.

@sudhirkk
Copy link

Oh ok. Thanks James! Sorry, if it sounds like a dump question. But, I have configured by doing aws configure and provided a unique key and passcode as well as region from EC2 terminal. But how does that link up with S3 bucket that I had created? What authentication that I have to match up? Your help is highly appreciated.

@sudhirkk
Copy link

Nevermind, I figured this out. It was a silly mistake from my side. Thanks for your help.

@jsdevel
Copy link

jsdevel commented Sep 16, 2014

I'm getting this error as well today. I made sure I was up to date with yum update.

Here is the command I'm running: aws elb deregister-instances-from-load-balancer --load-balancer-name $lbname --instances $instance

I've run aws configure with my access key and secret, and set the region to the availability zone that my instances and LB are in.

Here is the error I get:
HTTPSConnectionPool(host='elasticloadbalancing.us-west-2a.amazonaws.com', port=443): Max retries exceeded with url: / (Caused by <class 'socket.gaierror'>: [Errno -2] Name or service not known)

I've also tried using the DNS name for the --load-balancer-name, but it gives the same error.

@shlomoswidler
Copy link

@jsdevel Looks like you specified the availability zone us-west-2a where you should have specified the region us-west-2.

@jsdevel
Copy link

jsdevel commented Sep 21, 2014

ahh, nice @shlomoswidler! Thanks! I'll give that a shot on Monday ;)

@finnoon
Copy link

finnoon commented Sep 26, 2014

I'm having the same problem on a redhat linux ec2 instance. For ubuntu ec2's it's working no problem. I've tried setting my region to us-west-2b as well as us-west-2.

us-west-2b (works in ubuntu)
HTTPSConnectionPool(host='s3-us-west-2b.amazonaws.com', port=443): Max retries exceeded with url: /cu_bucket1/rc_att2/model_test.R (Caused by <class 'socket.gaierror'>: [Errno -2] Name or service not known)

us-west-2 (doesn't work in red hat)
A client error (Moved Permanently) occurred when calling the HeadObject operation: Moved Permanently
Completed 1 part(s) with ... file(s) remaining

I tried updating python to 3.4 and aws to 1.4.4, wasn't working for python 2.6

014-09-25 23:09:51,418 - MainThread - awscli.clidriver - DEBUG - CLI version: aws-cli/1.4.4 Python/3.4.1 Linux/2.6.32-431.11.2.el6.x86_64, botocore version: 0.63.0

I can attach a full debug if helpful. Has anyone had issue with red hat and the s3 portion of the cli?

@evleeann evleeann mentioned this issue Dec 19, 2014
Closed
@jbalonso jbalonso mentioned this issue Feb 1, 2016
Closed
@diehlaws diehlaws added pr:work-in-progress This PR is a draft and needs further work. and removed pending labels Jan 4, 2019
@mHamzaArain
Copy link

It's maybe you're not using AWS workspace for this just exclude active session e.g;
From this,
from workspace_utils import active_session
with active_session():
losses = train(D, G, n_epochs=n_epochs)

To this,
losses = train(D, G, n_epochs=n_epochs)

thoward-godaddy pushed a commit to thoward-godaddy/aws-cli that referenced this issue Feb 12, 2022
@jfuss
fix: Create Layer Cache during building image (aws#823)
26baa67
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
pr:work-in-progress This PR is a draft and needs further work.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
10 participants
@ErikEvenson @jamesls @lashex @sudhirkk @jsdevel @alexlenail @shlomoswidler @finnoon @diehlaws @mHamzaArain