Skip to content

Commit

Permalink
Improve README examples
Browse files Browse the repository at this point in the history
See #135
  • Loading branch information
jart committed Dec 28, 2023
1 parent 0984ed8 commit 9e972b2
Showing 1 changed file with 4 additions and 6 deletions.
10 changes: 4 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -275,9 +275,9 @@ weights:
```sh
llamafile \
-m wizardcoder-python-13b-v1.0.Q8_0.gguf \
--temp 0 \
-r $'```\n' \
-p $'```c\nvoid *memcpy(char *dst, const char *src, size_t size) {\n'
--temp 0 -e \
-r '```\n' \
-p '```c\nvoid *memcpy(char *dst, const char *src, size_t size) {\n'
```

Here's a similar example that instead utilizes Mistral-7B-Instruct
Expand All @@ -286,9 +286,7 @@ weights for prose composition:
```sh
llamafile \
-m mistral-7b-instruct-v0.1.Q4_K_M.gguf \
--temp 0.7 \
-r $'\n' \
-p $'### Instruction: Write a story about llamas\n### Response:\n'
-p '[INST]Write a story about llamas[/INST]'
```

Here's an example of how llamafile can be used as an interactive chatbot
Expand Down

0 comments on commit 9e972b2

Please sign in to comment.