Skip to content
This repository has been archived by the owner on Feb 27, 2023. It is now read-only.

[docs]supernode file ha design doc #766

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

yunfeiyanggzq
Copy link
Member

@yunfeiyanggzq yunfeiyanggzq commented Aug 1, 2019

Ⅰ. Describe what this PR did

this pr is a branch of #758 and should be marged after it
I modify the supernodeAPI and dfget.Now the supernode ha is done,supernode can be ha.but there some bugs needed to be fixed,and design tests to tests ha. I will work on it

Ⅱ. Does this pull request fix one issue?

Ⅲ. Why don't you add test cases (unit test/integration test)? (你真的觉得不需要加测试吗?)

Ⅳ. Describe how to verify it

Ⅴ. Special notes for reviews

@codecov-io
Copy link

codecov-io commented Aug 1, 2019

Codecov Report

Merging #766 into master will decrease coverage by 0.01%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #766      +/-   ##
==========================================
- Coverage   39.66%   39.64%   -0.02%     
==========================================
  Files         109      109              
  Lines        6429     6429              
==========================================
- Hits         2550     2549       -1     
  Misses       3671     3671              
- Partials      208      209       +1
Impacted Files Coverage Δ
supernode/daemon/mgr/scheduler/manager.go 24.06% <0%> (-0.76%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8e41c83...7e0faa3. Read the comment docs.

@yeya24 yeya24 removed the areas/log label Aug 1, 2019
@yunfeiyanggzq yunfeiyanggzq changed the title feature:modify supernodeAPI and dfget's download logic to implement ha(HA fourth part) [WIP]feature:modify supernodeAPI and dfget's download logic to implement ha(HA fourth part) Aug 1, 2019
@yunfeiyanggzq yunfeiyanggzq changed the title [WIP]feature:modify supernodeAPI and dfget's download logic to implement ha(HA fourth part) [docs]supernode file ha design doc Aug 21, 2019
Signed-off-by: yunfeiyangbuaa <[email protected]>
@allencloud
Copy link
Contributor

Could we add a HA architecture picture for this? I think a picture could express more data that just code and words. WDYT? @yunfeiyangbuaa

@yunfeiyanggzq
Copy link
Member Author

Could we add a HA architecture picture for this? I think a picture could express more data that just code and words. WDYT? @yunfeiyangbuaa
I put a picture in the doc,but the picture can't show in file changed,you can see this


## Tool Introduction

We can use distributed key-value store system such as etcd,zookeeper,consul and so on to manager the supernodes cluster.of course you can implement your own function to get supernodes information.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

of course -> Of course,
now -> Now


- Every supernode is stand-alone,so supernode can't communicate with each other for a better schedule.For example,pieces of a task are in different p2p network,so a supernode can only schedule its plan with its own peer instead of other peer which has pieces of a task in other p2p network.

- Every supernode will download the same file repeatedly,which makes download slowly and a waste of disk place.This will be obvious when the supernode's num is large.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"makes download slowly and a waste of disk place" -> makes download slow and wastes disk space.
"the supernode's num" -> the number of supernodes

sungjunyoung pushed a commit to sungjunyoung/Dragonfly that referenced this pull request May 8, 2022
* feat: add lint errcheck and fix errcheck

Signed-off-by: Gaius <[email protected]>

* replace assert to require

Signed-off-by: 孙伟鹏 <[email protected]>

Co-authored-by: 孙伟鹏 <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants