Skip to content

Commit

Permalink
Update the installation of CloudTik based on cloud providers (oap-pro…
Browse files Browse the repository at this point in the history
  • Loading branch information
Hong authored Jan 21, 2022
1 parent 60cf561 commit fe4d373
Show file tree
Hide file tree
Showing 4 changed files with 24 additions and 8 deletions.
25 changes: 21 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,8 @@ of taking a lot of time constructing the cluster and platform.


## Getting Started with CloudTik
### 1. Pepare Python environment
CloudTik requires a Python envornment to run. We suggest you use Conda to manage Python environments and pakages. If you don't have Conda , you can refer ```dev/install-conda.sh``` to install conda on Ubuntu systems.
### 1. Prepare Python environment
CloudTik requires a Python environment to run. We suggest you use Conda to manage Python environments and packages. If you don't have Conda , you can refer ```dev/install-conda.sh``` to install conda on Ubuntu systems.
```
bash dev/install-conda.sh; ## Optional
```
Expand All @@ -18,10 +18,27 @@ conda create -n cloudtik -y python=3.7;
conda activate cloudtik;
```
### 2. Install CloudTik
Installation of CloudTik is simple. Execute the below pip commands to install CloudTik to the working machine.
Installation of CloudTik is simple. Execute the below pip commands to install CloudTik to the working machine
for specific cloud providers.

```
pip install -U http://23.95.96.95:8000/latest/cloudtik-0.9.0-cp37-cp37m-manylinux2014_x86_64.whl
# if running CloudTik on aws
pip install -U "cloudtik[aws] @ http://23.95.96.95:8000/latest/cloudtik-0.9.0-cp37-cp37m-manylinux2014_x86_64.whl"
# if running CloudTik on azure
pip install -U "cloudtik[azure] @ http://23.95.96.95:8000/latest/cloudtik-0.9.0-cp37-cp37m-manylinux2014_x86_64.whl"
# if running CloudTik on gcp
pip install -U "cloudtik[gcp] @ http://23.95.96.95:8000/latest/cloudtik-0.9.0-cp37-cp37m-manylinux2014_x86_64.whl"
# if running CloudTik on k8s
pip install -U "cloudtik[k8s] @ http://23.95.96.95:8000/latest/cloudtik-0.9.0-cp37-cp37m-manylinux2014_x86_64.whl"
# if need support for all above
pip install -U "cloudtik[all] @ http://23.95.96.95:8000/latest/cloudtik-0.9.0-cp37-cp37m-manylinux2014_x86_64.whl"
```
for
### 3. Configure Credentials for Cloud Providers

#### Configure for AWS
Expand Down
2 changes: 1 addition & 1 deletion python/cloudtik/providers/aws/defaults.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -126,7 +126,7 @@ setup_commands:
- >-
(stat $HOME/anaconda3/envs/tensorflow2_latest_p37/ &> /dev/null &&
echo 'export PATH="$HOME/anaconda3/envs/tensorflow2_latest_p37/bin:$PATH"' >> ~/.bashrc) || true
- which cloudtik || pip install -U http://23.95.96.95:8000/latest/cloudtik-0.9.0-cp37-cp37m-manylinux2014_x86_64.whl
- which cloudtik || pip install -U "cloudtik[aws] @ http://23.95.96.95:8000/latest/cloudtik-0.9.0-cp37-cp37m-manylinux2014_x86_64.whl"

# Custom commands that will be run on the head node after common setup.
head_setup_commands:
Expand Down
2 changes: 1 addition & 1 deletion python/cloudtik/providers/azure/defaults.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -123,7 +123,7 @@ setup_commands:
- (which conda && echo 'eval "$(conda shell.bash hook)"' >> ~/.bashrc) || true
# - (conda activate py38_pytorch &> /dev/null && echo 'conda activate py38_pytorch' >> ~/.bashrc) || true
- (conda activate py38_tensorflow &> /dev/null && echo 'conda activate py38_tensorflow' >> ~/.bashrc) || true
- which cloudtik || pip install -U "cloudtik[default] @ https://s3-us-west-2.amazonaws.com/ray-wheels/latest/ray-2.0.0.dev0-cp38-cp38-manylinux2014_x86_64.whl"
- which cloudtik || pip install -U "cloudtik[azure] @ http://23.95.96.95:8000/latest/cloudtik-0.9.0-cp37-cp37m-manylinux2014_x86_64.whl"
# Consider uncommenting these if you also want to run apt-get commands during setup
# - sudo pkill -9 apt-get || true
# - sudo pkill -9 dpkg || true
Expand Down
3 changes: 1 addition & 2 deletions python/cloudtik/providers/gcp/defaults.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -139,8 +139,7 @@ setup_commands:
- >-
(stat /opt/conda/bin/ &> /dev/null &&
echo 'export PATH="/opt/conda/bin:$PATH"' >> ~/.bashrc) || true
- which cloudtik || pip install -U https://s3-us-west-2.amazonaws.com/ray-wheels/latest/ray-2.0.0.dev0-cp37-cp37m-manylinux2014_x86_64.whl

- which cloudtik || pip install -U "cloudtik[gcp] @ http://23.95.96.95:8000/latest/cloudtik-0.9.0-cp37-cp37m-manylinux2014_x86_64.whl"

# Custom commands that will be run on the head node after common setup.
head_setup_commands:
Expand Down

0 comments on commit fe4d373

Please sign in to comment.