dfget supports HDFS

[BruceAko]

Description

Support dfget hdfs://example/config -O output to download HDFS object and support directory recursive downloading.

Related Issue

close #500

Motivation and Context

Dragonfly rust client does not support back-to-source downloading of different object storage protocols. Need to support HDFS protocol in dragonfly-client-backend crate, implemented based on trait Backend and it needs to support directory recursive downloading.

Screenshot

[codecov]

Codecov Report

Attention: Patch coverage is 20.10870% with 147 lines in your changes missing coverage. Please review.

Project coverage is 32.62%. Comparing base (6ce4297) to head (1360896).
Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
dragonfly-client-backend/src/hdfs.rs	15.71%	118 Missing ⚠️
dragonfly-client/src/bin/dfget/main.rs	7.69%	24 Missing ⚠️
dragonfly-client/src/resource/task.rs	0.00%	5 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #838      +/-   ##
==========================================
- Coverage   32.89%   32.62%   -0.27%     
==========================================
  Files          56       57       +1     
  Lines        8515     8686     +171     
==========================================
+ Hits         2801     2834      +33     
- Misses       5714     5852     +138     

Files with missing lines	Coverage Δ
dragonfly-client-backend/src/http.rs	96.94% <100.00%> (+0.09%)	⬆️
dragonfly-client-backend/src/lib.rs	98.37% <100.00%> (+0.02%)	⬆️
dragonfly-client-backend/src/object_storage.rs	84.25% <ø> (ø)
dragonfly-client/src/resource/piece.rs	50.74% <ø> (ø)
dragonfly-client/src/resource/task.rs	0.00% <0.00%> (ø)
dragonfly-client/src/bin/dfget/main.rs	26.31% <7.69%> (-0.57%)	⬇️
dragonfly-client-backend/src/hdfs.rs	15.71% <15.71%> (ø)

---- 🚨 Try these New Features:

• Flaky Tests Detection - Detect and resolve failed and flaky tests

[gaius-qi]

LGTM