Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Document the AWS_EC2_METADATA_DISABLED environment variable #5623

Closed
kdaily opened this issue Oct 9, 2020 · 3 comments · Fixed by awsdocs/aws-cli-user-guide#56
Closed

Document the AWS_EC2_METADATA_DISABLED environment variable #5623

kdaily opened this issue Oct 9, 2020 · 3 comments · Fixed by awsdocs/aws-cli-user-guide#56
Labels
configuration documentation This is a problem with documentation.

Comments

@kdaily
Copy link
Member

kdaily commented Oct 9, 2020

Is your feature request related to a problem? Please describe.

If no region is set, the AWS CLI tries to use the IMDS service to determine it. In some cases, like when running the AWS CLI on an Azure instance, another service can be running at the same non-routable IP address used by IMDS. One way to get around this is to explicitly set a region. However, there is an undocumented environment variable that can prevent the request to IMDS:

AWS_EC2_METADATA_DISABLED=true

Related issues:

Describe the solution you'd like

Document the environment variable in the user guide:

https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-envvars.html

Describe alternatives you've considered

Setting the region can prevent this behavior, but using the environment variable is more explicit in controlling it.

Additional context

None
@kdaily kdaily added the documentation This is a problem with documentation. label Oct 9, 2020
This was referenced Oct 9, 2020
Closed
Closed
Closed
This was referenced Oct 23, 2020
Closed
Open
@kdaily kdaily mentioned this issue Nov 24, 2020
Closed
5 tasks
kdaily added a commit to kdaily/aws-cli-user-guide that referenced this issue Nov 24, 2020
@kdaily
Add documentation for the AWS_EC2_METADATA_DISABLED environment varia…
ae0132c 
…ble.

Fixes aws/aws-cli#5623.
kdaily added a commit to kdaily/aws-cli-user-guide that referenced this issue Nov 24, 2020
@kdaily
Add documentation for the AWS_EC2_METADATA_DISABLED environment varia…
ad157d1 
…ble.

Fixes aws/aws-cli#5623.
kdaily added a commit to kdaily/aws-cli-user-guide that referenced this issue Nov 24, 2020
@kdaily
Add documentation for the AWS_EC2_METADATA_DISABLED environment varia…
ecb57c6 
…ble.

Fixes aws/aws-cli#5623.
kdaily added a commit to kdaily/aws-cli-user-guide that referenced this issue Nov 24, 2020
@kdaily
Add documentation for the AWS_EC2_METADATA_DISABLED environment varia…
877a64f 
…ble.

Fixes aws/aws-cli#5623.
@kdaily kdaily mentioned this issue Nov 24, 2020
Merged
@miketimofeev miketimofeev mentioned this issue Feb 25, 2021
Closed
7 tasks
@esamattis
Copy link

esamattis commented Mar 17, 2021 •
edited
Loading

Today our CI deploys in Github Actions started fail on AWS CLI commands (aws sts get-caller-identity, aws s3 sync). They print lines like

<botocore.awsrequest.AWSRequest object at 0x7f83d900af70>

and exit with 255 code. No other error messages.

Setting AWS_EC2_METADATA_DISABLED=true fixed the issue for us. Probably a networking issue with github vs. aws.

Posting this here since googling this brought me here and it might help others too.

@liarco liarco mentioned this issue Mar 18, 2021
Closed
seamuslowry added a commit to seamuslowry/brannigans-chess-frontend that referenced this issue Mar 19, 2021
@seamuslowry
add env variable
805d2ba 
aws/aws-cli#5623 (comment)
seamuslowry added a commit to seamuslowry/brannigans-chess-frontend that referenced this issue Mar 19, 2021
@seamuslowry
Version 1.0.1 (#88)
5780bdb 
* add env variable

aws/aws-cli#5623 (comment)

* set environment variables in env node

* Update s3-prod.yml
@dylanbannon dylanbannon mentioned this issue Mar 25, 2021
Merged
@MichelLosier MichelLosier mentioned this issue Apr 1, 2021
Merged
@kdaily
Copy link
Member Author

kdaily commented Apr 5, 2021

Hi all, this is now in the documentation of environment variables for the CLI:

https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-envvars.html

@kdaily kdaily closed this as completed Apr 5, 2021
@github-actions
Copy link

github-actions bot commented Apr 5, 2021

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please open a new issue that references this one. If you wish to keep having a conversation with other community members under this issue feel free to do so.

pst added a commit to kbst/terraform-kubestack that referenced this issue Apr 17, 2021
@pst
Disable metadata for AWS cli v2 in container entrypoint
cd9ca0f 
The v2 AWS cli throws an exception if run on Azure, e.g.
via Github Actions due to presumeabley due to the metadata
service using the same IP address.

Apparently handling exceptions is too difficult for AWS.

aws/aws-cli#5262
aws/aws-cli#5623
pst added a commit to kbst/terraform-kubestack that referenced this issue Apr 17, 2021
@pst
Disable metadata for AWS cli v2 in container entrypoint
5478192 
The v2 AWS cli throws an exception if run on Azure, e.g.
via Github Actions due to presumeabley due to the metadata
service using the same IP address.

Apparently handling exceptions is too difficult for AWS.

aws/aws-cli#5262
aws/aws-cli#5623
djbender added a commit to get-bridge/translation-sync that referenced this issue May 5, 2021
@djbender
Fix ci: <botocore.awsrequest.AWSRequest>
e4fcd4d 
ref: aws/aws-cli#5262
ref: aws/aws-cli#5623
@djbender djbender mentioned this issue May 5, 2021
Merged
djbender added a commit to get-bridge/translation-sync that referenced this issue May 5, 2021
@djbender
Fix ci: <botocore.awsrequest.AWSRequest> (#4)
3aff674 
ref: aws/aws-cli#5262
ref: aws/aws-cli#5623
@davidsmejia davidsmejia mentioned this issue Jul 15, 2021
Closed
@jashapiro jashapiro mentioned this issue Jul 15, 2021
Merged
@tobil4sk tobil4sk mentioned this issue Oct 27, 2021
Merged
@Oatelaus Oatelaus mentioned this issue Jun 24, 2022
Closed
10 tasks
3TUSK added a commit to teaconmc/Longjing that referenced this issue Jun 25, 2022
@3TUSK
Countermeasure for (possibly) aws/aws-cli#5623
edd0ad5 
This should solve the recent mysterious publication failure.
3TUSK added a commit to teaconmc/Longjing that referenced this issue Jun 26, 2022
@3TUSK
Another spot affacted by aws/aws-cli#5623
fff4cb5
3TUSK added a commit to teaconmc/Puer that referenced this issue Jun 30, 2022
@3TUSK
Workaround for aws/aws-cli#5623
dc3bddb
sio added a commit to sio/gitlab-runners-fleet that referenced this issue Apr 7, 2023
@sio
Fix S3 upload with awscli v2
0cc0d17 
https://florian.ec/blog/github-actions-awscli-errors/
aws/aws-cli#5623
actions/runner-images#2791
vvarg229 added a commit to vvarg229/neofs-node that referenced this issue Jul 18, 2023
@vvarg229
Disable aws ec2 metadata
3239f5f 
Fixed bug nspcc-dev/neofs-s3-gw#798
This bug is only reproducible on ubuntu-latest in github actions.
This is a bug specifically of github acions, not the neofs-s3-gw:
actions/runner-images#2791
aws/aws-cli#5623

Signed-off-by: Oleg Kulachenko <[email protected]>
vvarg229 added a commit to vvarg229/neofs-node that referenced this issue Jul 18, 2023
@vvarg229
Disable aws ec2 metadata
4201d47 
Fixed bug nspcc-dev/neofs-s3-gw#798
This bug is only reproducible on ubuntu-latest in github actions.
This is a bug specifically of github acions, not the neofs-s3-gw:
actions/runner-images#2791
aws/aws-cli#5623

Signed-off-by: Oleg Kulachenko <[email protected]>
@vvarg229 vvarg229 mentioned this issue Jul 18, 2023
Closed
vvarg229 added a commit to vvarg229/neofs-testcases that referenced this issue Jul 19, 2023
@vvarg229
Disable aws ec2 metadata
ed80ed1 
Fixed bug nspcc-dev/neofs-s3-gw#798
This is a test environment error, not neofs-s3-gw:
actions/runner-images#2791
aws/aws-cli#5623

Signed-off-by: Oleg Kulachenko <[email protected]>
@vvarg229 vvarg229 mentioned this issue Jul 19, 2023
Merged
roman-khimov added a commit to nspcc-dev/neofs-testcases that referenced this issue Jul 19, 2023
@roman-khimov
Disable aws ec2 metadata (#586)
2ad7951 
Fixed bug nspcc-dev/neofs-s3-gw#798
This is a test environment error, not neofs-s3-gw:
actions/runner-images#2791
aws/aws-cli#5623

Tests results:

https://github.com/vvarg229/neofs-node/actions/runs/5601200752/jobs/10244709153

https://http.t5.fs.neo.org/86C4P6uJC7gb5n3KkwEGpXRfdczubXyRNW5N9KeJRW73/216-1689781099/index.html#
vvarg229 added a commit to vvarg229/neofs-testcases that referenced this issue Jul 31, 2023
@vvarg229
Disable aws ec2 metadata
b4b1914 
Fixed bug nspcc-dev/neofs-s3-gw#798
This is a test environment error, not neofs-s3-gw:
actions/runner-images#2791
aws/aws-cli#5623

Signed-off-by: Oleg Kulachenko <[email protected]>
@mapleFU mapleFU mentioned this issue Aug 12, 2023
Closed
@tippmar-nr tippmar-nr mentioned this issue Dec 13, 2023
Closed
@maximlt maximlt mentioned this issue Nov 5, 2024
Merged
33 tasks
xquery-go added a commit to xquery-go/gitlab-fleet that referenced this issue Nov 27, 2024
@xquery-go
Fix S3 upload with awscli v2
f6a5e5f 
https://florian.ec/blog/github-actions-awscli-errors/
aws/aws-cli#5623
actions/runner-images#2791
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
configuration documentation This is a problem with documentation.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add documentation for AWS_EC2_METADATA_DISABLED env variable kdaily/aws-cli-user-guide
2 participants
@kdaily @esamattis