Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add async in read from s3 #2080

Closed

Conversation

YLShiJustFly
Copy link

Signed-off-by: YLShi [email protected]

What problem does this PR solve?

Issue Number: #xxx

Problem Summary:

What is changed and how it works?

What's Changed:

How it Works:

Side effects(Breaking backward compatibility? Performance regression?):

Check List

  • Relevant documentation/comments is changed or added
  • I acknowledge that all my contributions will be made under the project's license

@wuhongsong
Copy link
Contributor

recheck

@@ -532,14 +532,35 @@ int FileCacheManager::ReadFromS3(const std::vector<S3ReadRequest> &requests,
uint64_t start = butil::cpuwide_time_us();
if (async) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if async is enable, you can set(bool async = true;)

@cw123
Copy link
Contributor

cw123 commented Nov 28, 2022

ReadFromS3的实现中,还是默认的sync read。你的修改是解决 #2070 这个问题的吗?

In function of ReadFromS3, the default is still sync read.
Does your change address #2070?

@YLShiJustFly YLShiJustFly force-pushed the add_async_for_readfroms3 branch from d9db62a to 75433a3 Compare November 28, 2022 11:17
@wuhongsong
Copy link
Contributor

recheck

Copy link
Contributor

@cw123 cw123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  1. most read logic of sync read between async are same, extract common logic
  2. add some unit test case

@cw123
Copy link
Contributor

cw123 commented Nov 29, 2022

recheck

1 similar comment
@cw123
Copy link
Contributor

cw123 commented Dec 5, 2022

recheck

@ilixiaocui ilixiaocui mentioned this pull request Dec 7, 2022
2 tasks
@ilixiaocui
Copy link
Contributor

ilixiaocui commented Jan 5, 2023

cc@YLShiJustFly This pr has been opened for a long time, and the review comments have not been replied. Please resubmit the pr if necessary.

@ilixiaocui ilixiaocui closed this Jan 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants