Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update #5

Merged
merged 19 commits into from
Jul 26, 2022
Merged

Update #5

merged 19 commits into from
Jul 26, 2022

Conversation

ForJadeForest
Copy link
Owner

Description

Update

Litchilitchy and others added 19 commits July 25, 2022 14:40
* correct prepare_env.sh path

* Alternative way to prepare envs
* refactor: recontruct orca RayOnSparkContext init process.

* refactor: rename the function.

* refactor: format code

* refactor: activate RayOnSparkContext

* refactor: rename function name

* refactor: rename function name

* refactor: rename function

* fix: for OrcaRayContext, init num_ray_nodes and ray_node_cpu_cores after init and setup RayOnSparkContext.
* Update Occlum SparkPi K8s config and readme
* Update Occlum SparkPi docker config and readme
* avoid onnx model frequently save/load

* rename test class
* Created using Colaboratory

* Fix url

* Created using Colaboratory

* Created using Colaboratory

* Created using Colaboratory

* Created using Colaboratory

* Created using Colaboratory

* modify colab link

* update colab link

* Created using Colaboratory

* update colab link

* Update dllib_keras_api.ipynb

* remove log

* remove dashboard log

* bug fix

* Created using Colaboratory

* remove log and update link
* update doc

* update

* update

* update
)

* add new method 'main process'

* raise error

* rename remote_distributed_backend

* fix known issues

* fix typo

* fix code-style

* missing invalidInputError

* missing invalidInputError

* move is_main_process to ln329
* remove toc from landing page

* update extension version

* resolve version conflict

* remove toc in page

* fix toc

* fix toc

* revise toc

* revise toc

* revise toc

* revise toc

* revise toc

* revise toc

* revise toc

* revise toc

* revise toc
* add spark2.4.6 build with maven

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
* support read/write json file

* add scala UT

* update doc

Co-authored-by: Zhou <[email protected]>
* Refine time output
* Fix typo
* add spark backend test

* export the dir to PYTHONPATH
* replace head workers with current ray head

* move get_node_ip_address to a function

* recover get_node_ip in ray_worker
deploy python pypi
#5170)

* remove duplicate exposed APIs

* add openvino basic tests

* fix openvino workflow

* revert openvino api in pytorch

* fix env removal

* remove downloading in ut
* add bigdl backend

* add bigdl backend

* delete the dataloader.

* add bigdl backend

* modify the description about backend

* add bigdl test

* delete the bigdl backend test

* add the jep requirements

* delete protobuf and ray

* delete evaluate process when use bigdl backend

* modify the result in readme file
* remove duplicate code in random_split()
* give cross_hash_encode() the ability to process multi-pairs columns
* split now an alias for random_split
* cross_columns now an alias for cross_hash_encode
* update function call in wnd_preprocessing.py
@ForJadeForest ForJadeForest merged commit 13e4625 into ForJadeForest:main Jul 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.