Skip to content
This repository has been archived by the owner on Jun 23, 2022. It is now read-only.

feat(bulk-load): bulk load download part3 - replica parse metadata, verify files and update progress #475

Merged
merged 9 commits into from
May 28, 2020

Conversation

hycdong
Copy link
Contributor

@hycdong hycdong commented May 25, 2020

This pull request is about what will replica do after downloading metadata file and sst files.

  • if download metadata succeed, replica will parse metadata from file to local _metadata (in function parse_bulk_load_metadata)
  • if download sst file succeed, replica will compare sst file size and md5 with the value parsed from metadata (in function verify_file)
  • if pass verification, replica will update download progress (in function update_bulk_load_download_progress)
  • if current replica download all sst files, will turn bulk load status to downloaded (in function check_download_finish)

@hycdong hycdong changed the title feat(bulk-load): bulk load download part3 - replica verify files and update progress feat(bulk-load): bulk load download part3 - replica parse metadata, verify files and update progress May 25, 2020
@hycdong hycdong marked this pull request as ready for review May 26, 2020 01:52
acelyc111
acelyc111 previously approved these changes May 26, 2020
@hycdong hycdong closed this May 28, 2020
@hycdong hycdong reopened this May 28, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants