Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds the new AWS Extension Plugin for Data Prepper #2754

Merged

Conversation

dlvenable
Copy link
Member

@dlvenable dlvenable commented May 25, 2023

Description

This creates a new AWS Extension Plugin. With this initial PR, this plugin supports a standard approach to AWS credentials management.

To try to keep this PR from being too large, I only included the new plugin. You can see #2731 to get a sense of how this will be used in other plugins. I'll create follow-on PRs to incorporate this into the other plugins accordingly.

Issues Resolved

Resolves #2751

Check List

  • New functionality includes testing.
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

…tandardizing how we load AWS credentials. opensearch-project#2751

Signed-off-by: David Venable <[email protected]>
import static org.mockito.Mockito.when;

@ExtendWith(MockitoExtension.class)
class CredentialsProviderFactoryTest {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

graytaylor0
graytaylor0 previously approved these changes May 25, 2023
* The {@link ExtensionPlugin} class which adds the AWS Plugin to
* Data Prepper as an extension plugin. Everything starts from here.
*/
public class AwsPlugin implements ExtensionPlugin {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This does not need a @DataPrepperPlugin annotation?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, the Plugin Framework detects extensions by anything that implements ExtensionPlugin, so no annotation is needed.

I considered adding an annotation, but it would be empty, so I'm not sure it adds much value over just looking for sub-classes.

chenqi0805
chenqi0805 previously approved these changes May 25, 2023
…e case in a GitHub Action.

Signed-off-by: David Venable <[email protected]>
@dlvenable dlvenable dismissed stale reviews from chenqi0805 and graytaylor0 via 4656683 May 25, 2023 18:16
Copy link
Collaborator

@chenqi0805 chenqi0805 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

QUES: does it support multiple aws credentials with different identifier?

@dlvenable
Copy link
Member Author

QUES: does it support multiple aws credentials with different identifier?

Not in this revision. However, see #2570 for a proposal for that.

@dlvenable dlvenable merged commit 5655383 into opensearch-project:main May 25, 2023
@dlvenable dlvenable deleted the 2751-aws-plugin-credentials branch July 13, 2023 21:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support shared AWS credentials across pipeline components
3 participants