Skip to content

Commit

Permalink
example script for shortcut
Browse files Browse the repository at this point in the history
  • Loading branch information
yuchenlin committed Jun 28, 2024
1 parent 8e500fe commit e650f54
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,8 @@ export HF_HOME=/net/nfs/climate/tmp_cache/
### Shortcut to run a model

```bash
bash scripts/_common_vllm.sh m-a-p/neo_7b_instruct_v0.1 neo_7b_instruct_v0.1 4
bash scripts/_common_vllm.sh [hf_model_id] [model_pretty_name] [num_gpus]
# bash scripts/_common_vllm.sh m-a-p/neo_7b_instruct_v0.1 neo_7b_instruct_v0.1 4 # example
# 1st arg is hf_name; 2nd is the pretty name; 3rd is the number of shards (gpus)
```

Expand Down

0 comments on commit e650f54

Please sign in to comment.