Skip to content

Commit

Permalink
improve instructions a bit
Browse files Browse the repository at this point in the history
  • Loading branch information
mmoskal committed Feb 6, 2024
1 parent a0ae841 commit 1c7d380
Show file tree
Hide file tree
Showing 2 changed files with 14 additions and 5 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ while compiling rllm-cuda also requires libtorch and CUDA.
[rLLM on llama.cpp](./rllm-cpp) and [aicirt](./aicirt)
- **AICI with CUDA** has all of the above, plus CUDA and libtorch for
[rLLM on libtorch](./rllm-cuda);
this requires a CUDA-capable GPU (currently only 8.0 (A100) is supported)
this requires a CUDA-capable GPU (currently only compute capability 8.0 is supported; this includes A100+ or GeForce 30x0/40x0)
- **AICI with CUDA and vLLM (experimental)** is for our outdated vLLM integration

If you're not familiar with [devcontainers](https://containers.dev/),
Expand Down
17 changes: 13 additions & 4 deletions pyctrl/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,19 +15,28 @@ This is quite similar to [jsctrl](../jsctrl/README.md) but with Python instead o

## Usage

To run a PyCtrl sample (using controller tagged with `pyctrl-latest`) use:
You can build, upload, and tag the PyCtrl Wasm module using the `aici.sh` script
(this assumes a [running server](../README.md#running-local-server)):

```bash
../aici.sh run samples/test.py
../aici.sh build . --tag pyctrl-latest
```

If you want to build it yourself, use:
Then you can run a PyCtrl sample:

```bash
../aici.sh run --ctrl pyctrl-latest samples/test.py
```

In fact, `--ctrl pyctrl-latest` is the default when you pass a `.py` file as input,
so it can be skipped.
You can also build and run in one step (without tagging):

```bash
../aici.sh run --build . samples/test.py
```

You will see the console output of the program.
Either way, you will see the console output of the program.

The Python interpreter does not include the full Python standard library, however
[parts are bundled](./Lib).
Expand Down

0 comments on commit 1c7d380

Please sign in to comment.