Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support of egress provider to deliver data to a S3 storage #2016

Merged
merged 32 commits into from
Nov 8, 2022

Conversation

Egyptmaster
Copy link
Contributor

No description provided.

@Egyptmaster Egyptmaster requested review from a team and IEvangelist as code owners June 20, 2022 10:14
@dnfadmin
Copy link

dnfadmin commented Jun 20, 2022

CLA assistant check
All CLA requirements met.

@birojnayak
Copy link

CLA assistant check Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.❌ Egyptmaster sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

please make sure to sign CLA by .net foundation

Copy link

@birojnayak birojnayak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I also didn't see any Unit test, I also didn't find any for AzureBlob storage... we need to check with project owner about that.... thanks for working on it...

documentation/configuration.md Outdated Show resolved Hide resolved
documentation/configuration.md Outdated Show resolved Hide resolved
documentation/configuration.md Outdated Show resolved Hide resolved
src/Tools/dotnet-monitor/Egress/S3/MultiPartStream.cs Outdated Show resolved Hide resolved
Copy link
Member

@wiktork wiktork left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding some initial feedback

documentation/configuration.md Outdated Show resolved Hide resolved
documentation/configuration.md Outdated Show resolved Hide resolved
src/Tools/dotnet-monitor/Egress/S3/MultiPartStream.cs Outdated Show resolved Hide resolved
src/Tools/dotnet-monitor/dotnet-monitor.csproj Outdated Show resolved Hide resolved
documentation/configuration.md Outdated Show resolved Hide resolved
@birojnayak
Copy link

@Egyptmaster could you please sign the CLA first ? and do you have an ETA when you are going to incorporate the changes ? thank you !

@Egyptmaster
Copy link
Contributor Author

@Egyptmaster could you please sign the CLA first ? and do you have an ETA when you are going to incorporate the changes ? thank you !
Unfortunatelly there is currently a running discussion with my company leads about signing the CLA, hope that they accepted it soon. Afterwards I hoped to find the time to adapt the code according the comments.

@ghost ghost added the no-recent-activity Automatically added by bot after four weeks of inactivity label Sep 3, 2022
@ghost
Copy link

ghost commented Sep 3, 2022

The 'no-recent-activity' label has been added to this pull request due to four weeks without any activity. If there is no activity in the next six weeks, this pull request will automatically be closed. You can learn more about our stale PR policy here: https://github.com/dotnet/dotnet-monitor/blob/main/CONTRIBUTING.md#stale-pr-policy

@birojnayak
Copy link

@Egyptmaster could you please sign the CLA first ? and do you have an ETA when you are going to incorporate the changes ? thank you !
Unfortunatelly there is currently a running discussion with my company leads about signing the CLA, hope that they accepted it soon. Afterwards I hoped to find the time to adapt the code according the comments.

@Egyptmaster any updates ? if you don't have time, let me know , I can incorporate the changes needed for S3 egress cloning your PR and publish a new PR..

@Egyptmaster Egyptmaster closed this Sep 8, 2022
@Egyptmaster Egyptmaster reopened this Sep 8, 2022
@ghost ghost removed the no-recent-activity Automatically added by bot after four weeks of inactivity label Sep 8, 2022
@Egyptmaster
Copy link
Contributor Author

Sorry, wasn't my intention to close the pull-request. I finally received the go from my employer and signed the CLA. I will try to take care about the comments to finally get the PR done.

@Egyptmaster
Copy link
Contributor Author

@Egyptmaster could you please sign the CLA first ? and do you have an ETA when you are going to incorporate the changes ? thank you !
Unfortunatelly there is currently a running discussion with my company leads about signing the CLA, hope that they accepted it soon. Afterwards I hoped to find the time to adapt the code according the comments.

@Egyptmaster any updates ? if you don't have time, let me know , I can incorporate the changes needed for S3 egress cloning your PR and publish a new PR..

Hope that I catch all your comments. Thanks a lot.

@birojnayak
Copy link

Sorry, wasn't my intention to close the pull-request. I finally received the go from my employer and signed the CLA. I will try to take care about the comments to finally get the PR done.

no problem... thanks for working on it.. I have reviewed and posted some comments..

Copy link

@birojnayak birojnayak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for working on it.. almost there.. some minor comments to incorporate

documentation/configuration.md Outdated Show resolved Hide resolved
documentation/configuration.md Outdated Show resolved Hide resolved
documentation/configuration.md Outdated Show resolved Hide resolved
@Egyptmaster Egyptmaster force-pushed the feature/s3-egress-provider branch from 1d94d00 to b5e52c8 Compare September 8, 2022 07:26
@Egyptmaster Egyptmaster force-pushed the feature/s3-egress-provider branch from b5e52c8 to 922fde3 Compare September 8, 2022 07:51
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remaining comments which cannot be posted as a review comment to avoid GitHub Rate Limit

dotnet format

src/Tools/dotnet-monitor/Egress/S3/S3Storage.cs|40|
src/Tools/dotnet-monitor/Egress/S3/S3StorageEgressProvider.cs|40|

jander-msft
jander-msft previously approved these changes Nov 2, 2022
Copy link
Member

@jander-msft jander-msft left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm approving since I don't have any more comments or required changes at this time. However, there are build failures across all build legs. Please pull in the latest from main, update the schema.json baseline, fix all of the format violations that were added as comments, and correct any code analysis errors that should be appearing as part of the build.

@jander-msft
Copy link
Member

By the way, we are working on making egress providers to be extensions rather than built into dotnet-monitor. See #2500. You'll likely see the code refactored and possibly even moved to another repository (along with the Azure Blog egress provider).

This should not impact your PR so long as you fix up all remaining issues and get it approved and merged soon.

…oviderOptions.Validate.cs

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Egyptmaster and others added 8 commits November 3, 2022 04:39
…ss/S3/InMemoryS3.cs

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
…ss/S3/InMemoryS3.cs

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
…ss/S3/InMemoryS3.cs

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
…ss/S3/InMemoryS3.cs

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@Egyptmaster
Copy link
Contributor Author

Egyptmaster commented Nov 3, 2022

I'm approving since I don't have any more comments or required changes at this time. However, there are build failures across all build legs. Please pull in the latest from main, update the schema.json baseline, fix all of the format violations that were added as comments, and correct any code analysis errors that should be appearing as part of the build.

Well, is that really necessary to handle each compiler waring as an error here. That was changed in the meanwhile, right? I cannot remember to see these errors before. That start to becomre frustrating but I try to adapt the code...

@jander-msft
Copy link
Member

Well, is that really necessary to handle each compiler waring as an error here. That was changed in the meanwhile, right? I cannot remember to see these errors before. That start to becomre frustrating but I try to adapt the code...

Logging warnings as errors has been in this repository from the start, long before this PR was opened. However, what was changed was updating the code analysis toolset and applicable analyzers in #2771 on October 25th. This change flagged many violations compared to the previous toolset which needed to be addressed and any pending PRs need to adapt to them.

@schmittjoseph schmittjoseph added the update-release-notes Pull requests that should be mentioned in the release notes label Nov 3, 2022
…ss/S3/MultiPartUploadStreamTests.cs

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@Egyptmaster
Copy link
Contributor Author

Egyptmaster commented Nov 4, 2022

So now I only have a flacky test failing because of unknown reason.

System.Threading.Tasks.TaskCanceledException : A task was canceled.

Any clue?

@Egyptmaster
Copy link
Contributor Author

I see that the pull-request is approved! Thanks a lot. What comes next, who is merging it to the main?

@jander-msft jander-msft merged commit c70ed6f into dotnet:main Nov 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
update-release-notes Pull requests that should be mentioned in the release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants