Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aws_kms integration tests unstable #433

Closed
tremble opened this issue Feb 21, 2021 · 4 comments · Fixed by #1112
Closed

aws_kms integration tests unstable #433

tremble opened this issue Feb 21, 2021 · 4 comments · Fixed by #1112
Assignees
Labels
bug This issue/PR relates to a bug CI has_pr module module plugins plugin (any type)

Comments

@tremble
Copy link
Contributor

tremble commented Feb 21, 2021

SUMMARY

The aws_kms integration tests appear somewhat flaky, this mostly looks like it's due to 'eventual consistency' race conditions, with incorrect 'changed' results, and _info information that seems to be missing the previous change.

aws_kms may need waiters adding.

ISSUE TYPE
  • Bug Report
COMPONENT NAME
  • aws_kms
  • aws_kms_info
ANSIBLE VERSION

CI

CONFIGURATION

CI

OS / ENVIRONMENT

CI

STEPS TO REPRODUCE

Trigger integration test suites

EXPECTED RESULTS

tests consistently pass

ACTUAL RESULTS

Tests sporadically fail with errors like:

 aws_kms-ale83iyr / /root/ansible_collections/community/aws/tests/output/.tmp/integration/aws_kms-9651665y-ÅÑŚÌβŁÈ/tests/integration/targets/aws_kms/tasks/main.yml:333 / [testhost] testhost: aws_kms : assert no change to tags that=['not tag_kms_no_update.changed', "'tag_one' not in tag_kms_no_update.tags", "'tag_two' in tag_kms_no_update.tags", "tag_kms_no_update.tags.tag_two == 'tag_two_updated'", "'Tag Three' in tag_kms_update.tags", "tag_kms_update.tags['Tag Three'] == resource_prefix"]

failure: Assertion failed

{
    "assertion": "not tag_kms_no_update.changed",
    "changed": false,
    "evaluated_to": false,
    "msg": "Assertion failed"
}
 aws_kms-e8bbn_js / /root/ansible_collections/community/aws/tests/output/.tmp/integration/aws_kms-_xr85pv6-ÅÑŚÌβŁÈ/tests/integration/targets/aws_kms/tasks/main.yml:65 / [testhost] testhost: aws_kms : assert that state is enabled that=['"key_id" in create_kms', 'create_kms.key_id | length >= 36', 'not create_kms.key_id.startswith("arn:aws")', '"key_arn" in create_kms', 'create_kms.key_arn.endswith(create_kms.key_id)', 'create_kms.key_arn.startswith("arn:aws")', 'create_kms.key_state == "Enabled"', "create_kms.tags['Hello'] == 'World'", 'create_kms.enable_key_rotation == false']

failure: Assertion failed

{
    "assertion": "create_kms.enable_key_rotation == false",
    "changed": false,
    "evaluated_to": false,
    "msg": "Assertion failed"
}
@ansibullbot
Copy link

ansibullbot commented Feb 21, 2021

Files identified in the description:

If these files are inaccurate, please update the component name section of the description or use the !component bot command.

click here for bot help

@ansibullbot
Copy link

@ansibullbot ansibullbot added bug This issue/PR relates to a bug module module needs_triage plugins plugin (any type) labels Feb 21, 2021
@tremble tremble added the CI label Feb 22, 2021
@jatorcasso jatorcasso self-assigned this Mar 31, 2022
@ansibullbot
Copy link

@jatorcasso
Copy link
Contributor

@tremble I tried adding some manual waiters for tag updates, policy updates, etc, but still ran into testing failures. Im not sure what else to do aside from just sleeping after updates.. (PR is #1052)

@jatorcasso jatorcasso added backport-3 PR should be backported to the stable-3 branch and removed backport-3 PR should be backported to the stable-3 branch labels May 6, 2022
softwarefactory-project-zuul bot pushed a commit that referenced this issue May 7, 2022
aws_kms - stabilize integration tests

SUMMARY
Integration tests for this test suite were failing occasionally due to timing issues when waiting for < 45 seconds after updates.
Increased the wait times to 45 seconds and split into different tests to run in parallel.
Fixes #433
ISSUE TYPE

Bugfix Pull Request

COMPONENT NAME
aws_kms

Reviewed-by: Jill R <None>
Reviewed-by: Markus Bergholz <[email protected]>
patchback bot pushed a commit that referenced this issue May 7, 2022
aws_kms - stabilize integration tests

SUMMARY
Integration tests for this test suite were failing occasionally due to timing issues when waiting for < 45 seconds after updates.
Increased the wait times to 45 seconds and split into different tests to run in parallel.
Fixes #433
ISSUE TYPE

Bugfix Pull Request

COMPONENT NAME
aws_kms

Reviewed-by: Jill R <None>
Reviewed-by: Markus Bergholz <[email protected]>
(cherry picked from commit cda4830)
softwarefactory-project-zuul bot pushed a commit that referenced this issue May 9, 2022
[PR #1112/cda48303 backport][stable-3] aws_kms - stabilize integration tests

This is a backport of PR #1112 as merged into main (cda4830).
SUMMARY
Integration tests for this test suite were failing occasionally due to timing issues when waiting for < 45 seconds after updates.
Increased the wait times to 45 seconds and split into different tests to run in parallel.
Fixes #433
ISSUE TYPE

Bugfix Pull Request

COMPONENT NAME
aws_kms

Reviewed-by: Alina Buzachis <None>
alinabuzachis added a commit to alinabuzachis/community.aws that referenced this issue May 25, 2022
…sible-collections#433)

ec2_instance -  Support throughtput parameter for GP3 volume types

SUMMARY

ec2_instance - Support throughput parameter for GP3 volume types
Fixes ansible-collections#395
ISSUE TYPE


Feature Pull Request

COMPONENT NAME

ec2_instance

Reviewed-by: Markus Bergholz <[email protected]>
Reviewed-by: Mark Chappell <None>
Reviewed-by: Alina Buzachis <None>
Reviewed-by: Jill R <None>
Reviewed-by: None <None>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug This issue/PR relates to a bug CI has_pr module module plugins plugin (any type)
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants