Skip to content

Commit

Permalink
pixtral-large alias plus aliases in README, closes #14
Browse files Browse the repository at this point in the history
  • Loading branch information
simonw committed Nov 19, 2024
1 parent 98e0ae7 commit ec5db4f
Show file tree
Hide file tree
Showing 4 changed files with 30 additions and 3 deletions.
4 changes: 3 additions & 1 deletion .github/workflows/test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -25,4 +25,6 @@ jobs:
- name: Run tests
run: |
pytest
- name: Check if cog is needed
run: |
cog --check README.md
24 changes: 24 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,30 @@ All three models accept the following options, using `-o name value` syntax:
- `-o safe_mode 1`: Turns on [safe mode](https://docs.mistral.ai/platform/guardrailing/), which adds a system prompt to add guardrails to the model output.
- `-o random_seed 123`: Set an integer random seed to generate deterministic results.

## Available models

Run `llm models` for a full list of Mistral models. This plugin configures the following alias shortcuts:

<!-- [[[cog
import cog, json
from llm_mistral import DEFAULT_ALIASES
for model_id, alias in DEFAULT_ALIASES.items():
cog.out(f"- `{alias}` for `{model_id}`\n")
]]] -->
- `mistral-tiny` for `mistral/mistral-tiny`
- `mistral-nemo` for `mistral/open-mistral-nemo`
- `mistral-small` for `mistral/mistral-small`
- `mistral-medium` for `mistral/mistral-medium`
- `mistral-large` for `mistral/mistral-large-latest`
- `codestral-mamba` for `mistral/codestral-mamba-latest`
- `codestral` for `mistral/codestral-latest`
- `ministral-3b` for `mistral/ministral-3b-latest`
- `ministral-8b` for `mistral/ministral-8b-latest`
- `pixtral-12b` for `mistral/pixtral-12b-latest`
- `pixtral-large` for `mistral/pixtral-large-latest`
<!-- [[[end]]] -->


## Refreshing the model list

Mistral sometimes release new models.
Expand Down
3 changes: 2 additions & 1 deletion llm_mistral.py
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,8 @@
"mistral/codestral-latest": "codestral",
"mistral/ministral-3b-latest": "ministral-3b",
"mistral/ministral-8b-latest": "ministral-8b",
"mistral/pixtral-12b": "pixtral-12b",
"mistral/pixtral-12b-latest": "pixtral-12b",
"mistral/pixtral-large-latest": "pixtral-large",
}


Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -24,4 +24,4 @@ CI = "https://github.com/simonw/llm-mistral/actions"
mistral = "llm_mistral"

[project.optional-dependencies]
test = ["pytest", "pytest-httpx", "pytest-asyncio"]
test = ["cogapp", "pytest", "pytest-httpx", "pytest-asyncio"]

0 comments on commit ec5db4f

Please sign in to comment.