Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Improvement-13804] Optimal HDFS configuration acquisition (#13804) #13811

Merged
merged 1 commit into from
Apr 20, 2023

Conversation

zhaifb
Copy link
Contributor

@zhaifb zhaifb commented Mar 29, 2023

defaultFS key from FS_DEFAULT_FS to HDFS_DEFAULT_FS

Purpose of the pull request

This pull request is Optimal HDFS configuration acquisition

  1. Get configration from Configration (core-site.xml hdfs-site.xml)
  2. Get configration from Properties (common.properties)

change 1. from FS_DEFAULT_FS( resource.hdfs.fs.defaultFS ) to HDFS_DEFAULT_FS ( fs.defaultFS)

close #13804

Brief change log

Verify this pull request

This pull request is code cleanup without any test coverage.

(or)

This pull request is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(or)

If your pull request contain incompatible change, you should also add it to docs/docs/en/guide/upgrede/incompatible.md

@SbloodyS SbloodyS added first time contributor First-time contributor improvement make more easy to user or prompt friendly backend 3.2.0 for 3.2.0 version labels Mar 29, 2023
@SbloodyS SbloodyS modified the milestones: 3.1.5, 3.2.0 Mar 29, 2023
@codecov-commenter
Copy link

codecov-commenter commented Mar 30, 2023

Codecov Report

Merging #13811 (66a562a) into dev (53bcf11) will decrease coverage by 0.02%.
The diff coverage is 50.00%.

❗ Current head 66a562a differs from pull request most recent head acaa87c. Consider uploading reports for the commit acaa87c to get more accurate results

@@             Coverage Diff              @@
##                dev   #13811      +/-   ##
============================================
- Coverage     38.90%   38.89%   -0.02%     
+ Complexity     4470     4466       -4     
============================================
  Files          1164     1164              
  Lines         42444    42444              
  Branches       4761     4761              
============================================
- Hits          16512    16507       -5     
- Misses        24114    24116       +2     
- Partials       1818     1821       +3     
Impacted Files Coverage Δ
...duler/plugin/storage/hdfs/HdfsStorageOperator.java 19.65% <50.00%> (-0.69%) ⬇️

... and 3 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@github-actions github-actions bot removed the backend label Mar 31, 2023
@zhaifb zhaifb requested review from SbloodyS and Radeity April 3, 2023 01:29
@zhaifb zhaifb force-pushed the Improvement-13804 branch 2 times, most recently from d8cd6ae to e47dda7 Compare April 13, 2023 09:22
)

defaultFS key from FS_DEFAULT_FS to HDFS_DEFAULT_FS
@sonarcloud
Copy link

sonarcloud bot commented Apr 20, 2023

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

50.0% 50.0% Coverage
0.0% 0.0% Duplication

Copy link
Member

@SbloodyS SbloodyS left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@SbloodyS SbloodyS merged commit 3305d6d into apache:dev Apr 20, 2023
xiaows08 pushed a commit to xiaows08/dolphinscheduler that referenced this pull request Apr 21, 2023
) (apache#13811)

defaultFS key from FS_DEFAULT_FS to HDFS_DEFAULT_FS
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3.2.0 for 3.2.0 version first time contributor First-time contributor improvement make more easy to user or prompt friendly
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Improvement][storage-hdfs] first getDefaultFS change FS_DEFAULT_FS to HDFS_DEFAULT_FS
4 participants