Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rds enhanced monitoring bug fix #747

Merged

Conversation

marknet15
Copy link
Contributor

@marknet15 marknet15 commented Oct 8, 2021

SUMMARY

(a copy of #712 as I messed up my branch by accident)

This is a fix for an issue when an RDS instance already exists and you wish to enable enhanced monitoring, for the full details see the linked old reported issue:
ansible/ansible#51772

But in summary currently if you enable enhanced monitoring on an RDS instance that already exists where it isn't already enabled then the following is returned:

An exception occurred during task execution. To see the full traceback, use -vvv. The error was: KeyError: 'MonitoringRoleArn'
fatal: [localhost_eu-west-1-pdv-qa-1 -> 127.0.0.1]: FAILED! => changed=false 
  module_stderr: |-
    Traceback (most recent call last):
      File "master:/opt/mitogen/mitogen-0.2.9/ansible_mitogen/runner.py", line 975, in _run
        self._run_code(code, mod)
      File "master:/opt/mitogen/mitogen-0.2.9/ansible_mitogen/runner.py", line 939, in _run_code
        exec(code, vars(mod))
      File "master:/tmp/build/4bef5c86/framework/library/cloud/aws/rds_instance.py", line 1245, in <module>
      File "master:/tmp/build/4bef5c86/framework/library/cloud/aws/rds_instance.py", line 1210, in main
      File "master:/tmp/build/4bef5c86/framework/library/cloud/aws/rds_instance.py", line 855, in get_parameters
      File "master:/tmp/build/4bef5c86/framework/library/cloud/aws/rds_instance.py", line 885, in get_options_with_changing_values
      File "master:/tmp/build/4bef5c86/framework/library/cloud/aws/rds_instance.py", line 983, in get_changing_options_with_consistent_keys
    KeyError: 'MonitoringRoleArn'
  module_stdout: ''
  msg: |-
    MODULE FAILURE
    See stdout/stderr for the exact error

Originally-Depends-On: mattclay/aws-terminator#164

Other changes
A load of issues have surfaced in the integration tests due to how slow RDS is to create / modify etc. I've condensed down the tests where possible reducing the number of inventory jobs to 6 and bumped serial to 6 so that hopefully all tests can run at once and finish within the 1 hr AWS session duration.

ISSUE TYPE
  • Bugfix Pull Request
COMPONENT NAME

rds_instance

@marknet15
Copy link
Contributor Author

recheck

@ansibullbot
Copy link

@ansibullbot ansibullbot added bug This issue/PR relates to a bug community_review integration tests/integration module module needs_triage plugins plugin (any type) tests tests traceback labels Oct 8, 2021
@marknet15
Copy link
Contributor Author

recheck

2 similar comments
@marknet15
Copy link
Contributor Author

recheck

@marknet15
Copy link
Contributor Author

recheck

@marknet15 marknet15 closed this Oct 8, 2021
@marknet15 marknet15 reopened this Oct 8, 2021
@marknet15 marknet15 force-pushed the rds-enhanced-monitoring branch from e056ea8 to b1e419d Compare October 9, 2021 15:05
@marknet15
Copy link
Contributor Author

recheck

2 similar comments
@marknet15
Copy link
Contributor Author

recheck

@gundalow
Copy link
Contributor

recheck

@jillr
Copy link
Collaborator

jillr commented Oct 11, 2021

recheck

@marknet15
Copy link
Contributor Author

@jillr @gundalow the recheck doesn't seem to be triggering Zuul for some reason now! I'm a little unsure on what to try next, this was a clean branch with cherry picked commits as I messed up a rebase on the old branch. I also tried creating a brand new commit on a new branch and it also doesn't seem to want to trigger :(

@marknet15
Copy link
Contributor Author

@jillr @gundalow do labels effect Zuul test triggering ? I notice this PR has the “traceback” label no other open PRs seem to

@jillr
Copy link
Collaborator

jillr commented Oct 11, 2021

@marknet15 The labels do not affect Zuul and I don't see anything that looks wrong here. Unfortunately all of our Zuul experts are in Canada and on public holiday today, tomorrow we should be able to figure out more.

@tremble tremble closed this Oct 12, 2021
@tremble tremble reopened this Oct 12, 2021
@tremble tremble closed this Oct 12, 2021
@tremble tremble reopened this Oct 12, 2021
@marknet15
Copy link
Contributor Author

recheck

@marknet15
Copy link
Contributor Author

recheck

2 similar comments
@alinabuzachis
Copy link
Contributor

recheck

@marknet15
Copy link
Contributor Author

recheck

@marknet15 marknet15 changed the title Rds enhanced monitoring Rds enhanced monitoring bug fix Oct 14, 2021
@marknet15
Copy link
Contributor Author

recheck

@marknet15 marknet15 force-pushed the rds-enhanced-monitoring branch from e55d3a9 to 861463e Compare October 15, 2021 14:44
@marknet15
Copy link
Contributor Author

marknet15 commented Oct 15, 2021

@alinabuzachis @jillr @tremble this is finally ready for a review :) the tests now run and complete within the 1hr session

@marknet15 marknet15 force-pushed the rds-enhanced-monitoring branch from 861463e to 7e2cd42 Compare October 18, 2021 11:34
test update

correct test var

Enable tests

Update tests/integration/targets/rds_instance/aliases

Co-authored-by: Mark Chappell <[email protected]>

try leaving out the iam deletion for enhanced monitoring

move IAM creation to earlier on

The tests are exceeding a 1hr session limit

- Condense tests where possible
- Remove irrelevant snapshot tests
- Up concurrency to 6

PR feedback

disable wait on final delete

further adjust

update changelog

speed up tests

speed up tests

test failure fixes

fix final broken test

split tagging out

test adjustments

final test failure

hitting max length

modify tests adjust

version bump fix
@marknet15 marknet15 force-pushed the rds-enhanced-monitoring branch from 7e2cd42 to e839bc1 Compare October 18, 2021 12:35
@marknet15
Copy link
Contributor Author

recheck

2 similar comments
@marknet15
Copy link
Contributor Author

recheck

@marknet15
Copy link
Contributor Author

recheck

@marknet15 marknet15 requested a review from tremble October 20, 2021 14:20
@tremble tremble requested a review from alinabuzachis October 22, 2021 12:51
Copy link
Contributor

@tremble tremble left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The bugfix itself looks sound. Tests changes look ok, even if we've dropped some of the tests, and I've missed it, this is better than running no tests.

@tremble tremble added the gate label Oct 22, 2021
Copy link
Contributor

@ansible-zuul ansible-zuul bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@ansible-zuul ansible-zuul bot merged commit 8fe00cb into ansible-collections:main Oct 22, 2021
@marknet15 marknet15 deleted the rds-enhanced-monitoring branch October 22, 2021 15:37
abikouo pushed a commit to abikouo/community.aws that referenced this pull request Oct 24, 2023
Rds enhanced monitoring bug fix

SUMMARY
(a copy of ansible-collections#712 as I messed up my branch by accident)
This is a fix for an issue when an RDS instance already exists and you wish to enable enhanced monitoring, for the full details see the linked old reported issue:
ansible/ansible#51772
But in summary currently if you enable enhanced monitoring on an RDS instance that already exists where it isn't already enabled then the following is returned:
An exception occurred during task execution. To see the full traceback, use -vvv. The error was: KeyError: 'MonitoringRoleArn'
fatal: [localhost_eu-west-1-pdv-qa-1 -> 127.0.0.1]: FAILED! => changed=false
  module_stderr: |-
    Traceback (most recent call last):
      File "master:/opt/mitogen/mitogen-0.2.9/ansible_mitogen/runner.py", line 975, in _run
        self._run_code(code, mod)
      File "master:/opt/mitogen/mitogen-0.2.9/ansible_mitogen/runner.py", line 939, in _run_code
        exec(code, vars(mod))
      File "master:/tmp/build/4bef5c86/framework/library/cloud/aws/rds_instance.py", line 1245, in <module>
      File "master:/tmp/build/4bef5c86/framework/library/cloud/aws/rds_instance.py", line 1210, in main
      File "master:/tmp/build/4bef5c86/framework/library/cloud/aws/rds_instance.py", line 855, in get_parameters
      File "master:/tmp/build/4bef5c86/framework/library/cloud/aws/rds_instance.py", line 885, in get_options_with_changing_values
      File "master:/tmp/build/4bef5c86/framework/library/cloud/aws/rds_instance.py", line 983, in get_changing_options_with_consistent_keys
    KeyError: 'MonitoringRoleArn'
  module_stdout: ''
  msg: |-
    MODULE FAILURE
    See stdout/stderr for the exact error

Originally-Depends-On: mattclay/aws-terminator#164
Other changes
A load of issues have surfaced in the integration tests due to how slow RDS is to create / modify etc. I've condensed down the tests where possible reducing the number of inventory jobs to 6 and bumped serial to 6 so that hopefully all tests can run at once and finish within the 1 hr AWS session duration.
ISSUE TYPE

Bugfix Pull Request

COMPONENT NAME
rds_instance

Reviewed-by: Mark Chappell <None>
Reviewed-by: Mark Woolley <[email protected]>
Reviewed-by: None <None>

This commit was initially merged in https://github.com/ansible-collections/community.aws
See: ansible-collections@8fe00cb
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug This issue/PR relates to a bug community_review integration tests/integration module module plugins plugin (any type) tests tests traceback
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants