Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[exporter/awss3] S3 Exporter #20912

Merged
merged 12 commits into from
Apr 27, 2023
Merged

Conversation

atoulme
Copy link
Contributor

@atoulme atoulme commented Apr 15, 2023

Description:
This is a reprisal of #10000, rebased, and modified to match best practices. It also adds support for metrics.

Link to tracking Issue:
Fixes #2835

Testing:
Unit tests.

Documentation:
README

@pdelewski
Copy link
Member

@atoulme LGTM. I think it would be good to do some e2e tests, however I don't want to block this PR. Let me know what do you think.

@rachanaguptaHPE
Copy link

May I know when this PR will be merged to the main?

@atoulme
Copy link
Contributor Author

atoulme commented Apr 18, 2023

@pdelewski can you create an issue for e2e tests please? We can discuss it separately.

@pdelewski
Copy link
Member

@pdelewski can you create an issue for e2e tests please? We can discuss it separately.

Yes, sure

@atoulme
Copy link
Contributor Author

atoulme commented Apr 18, 2023

Rebased off latest main.

@atoulme atoulme added the ready to merge Code review completed; ready to merge by maintainers label Apr 20, 2023
@atoulme
Copy link
Contributor Author

atoulme commented Apr 20, 2023

@pdelewski I talked about this PR with @dmitryax and he asked me if we had any way to read otlp_proto data back. If we cannot, should we consider removing it for now while we figure a plan to use it?

@codeboten codeboten removed the ready to merge Code review completed; ready to merge by maintainers label Apr 21, 2023
@codeboten
Copy link
Contributor

@atoulme i removed the ready to merge label until the pdata question is resolved

@pdelewski
Copy link
Member

@pdelewski I talked about this PR with @dmitryax and he asked me if we had any way to read otlp_proto data back. If we cannot, should we consider removing it for now while we figure a plan to use it?

@atoulme It's not clear why do we need to read otlp_proto data back?

@atoulme
Copy link
Contributor Author

atoulme commented Apr 24, 2023

@pdelewski well, if you store that data in S3, do you want a way to make sense of it? How will this data be read after? It's ok if the collector is not involved, just looking for why. It's likely that if we offer this option users will store as proto data and come back to ask us what to do with it next. At least with JSON we have a couple ways to make sense of it.

@pdelewski
Copy link
Member

@atoulme ok, so it's about semantic meaning (schema). That's something I have not taken into account, yet.

@atoulme
Copy link
Contributor Author

atoulme commented Apr 24, 2023

@pdelewski Can we remove it for now while we figure this out?

@pdelewski
Copy link
Member

@atoulme You mean removing #9979? That's ok for me.

@atoulme
Copy link
Contributor Author

atoulme commented Apr 24, 2023

No - I'll make a code change to show you, hold on.

@atoulme
Copy link
Contributor Author

atoulme commented Apr 25, 2023

@pdelewski I have removed the binary protobuf marshaler, see 43ac4c9

@dmitryax dmitryax merged commit 6b98866 into open-telemetry:main Apr 27, 2023
@github-actions github-actions bot added this to the next release milestone Apr 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add an S3 exporter
6 participants