Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML-25] Fix oneCCL KVS port auto detect and improve logging #24

Merged
merged 2 commits into from
Feb 9, 2021

Conversation

xwu99
Copy link
Collaborator

@xwu99 xwu99 commented Feb 9, 2021

What changes were proposed in this pull request?

#25

  • Fix oneCCL KVS port auto detect
  • Improve logging:
    • Use stderr for native logging
    • Use spark.internal.Logging for Scala logging
    • Use slf4j for Java logging

Improve logging:
  Use stderr for native logging
  Use spark.internal.Logging for Scala logging
  Use slf4j for Java logging
@github-actions
Copy link

github-actions bot commented Feb 9, 2021

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?
https://github.com/oap-project/oap-mllib/issues

Then could you also rename pull request title and commit log in the following format?

[ML-${ISSUES_ID}] ${detailed message}

See also:

@xwu99 xwu99 changed the title Fix oneCCL KVS port auto detect and improve logging [ML-25] Fix oneCCL KVS port auto detect and improve logging Feb 9, 2021
@github-actions
Copy link

github-actions bot commented Feb 9, 2021

#25

@xwu99 xwu99 merged commit 9080d02 into oap-project:master Feb 9, 2021
@xwu99 xwu99 linked an issue Feb 9, 2021 that may be closed by this pull request
xwu99 added a commit to xwu99/oap-mllib that referenced this pull request Mar 19, 2021
xwu99 added a commit to xwu99/oap-mllib that referenced this pull request Mar 19, 2021
xwu99 added a commit that referenced this pull request Mar 23, 2021
* Revert "[ML-33] Optimize oneCCL port detecting (#34)"

This reverts commit c07d70c.

* Revert "[ML-12] Improve CI and add pseudo cluster testing (#20)"

This reverts commit 6fe5d3e.

* Revert "Print time duration for each PCA step (#32)"

This reverts commit e1c33d9.

* Revert "[ML-13] Add ALS with new oneCCL APIs (#14)"

This reverts commit 3252ae9.

* Revert "[ML-25] Fix oneCCL KVS port auto detect and improve logging (#24)"

This reverts commit 9080d02.

* Revert "[ML-18]  Auto detect KVS port for oneCCL to avoid port conflict (#19)"

This reverts commit ac20823.

* Revert "Merge pull request #11 from xwu99/new-oneccl"

This reverts commit b60158b, reversing
changes made to db2414c.

* Revert "use spark.oap.mllib.oneccl.kvs.ip to workaround KVS IP hang issue"

This reverts commit 318cae1.

* Revert "Add IP Port kvs_attr and Kmeans, PCA test cases validated"

This reverts commit 99b9551.

* Revert "Port oneccl to new C++ apis"

This reverts commit ac216f4.

* Fix Makefile
Add build.sh
Fix oap-mllib-ci.yml
Fix OneCCL port for multiple test run

* Remove kmeans-hibench example

* modify README

* modify README

* modify README
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Fix oneCCL KVS port auto detect and improve logging
1 participant