Skip to content

Commit

Permalink
fix: Update models to include whether they support streaming, and add…
Browse files Browse the repository at this point in the history 
… validation to check whether a model supports streaming
  • Loading branch information
@sam-goldman
sam-goldman committed Jul 14, 2024
1 parent 5bc2508 commit c449fea
Show file tree
Hide file tree
Showing 16 changed files with 252 additions and 140 deletions.
5 changes: 5 additions & 0 deletions .changeset/short-seahorses-fix.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
---
'token.js': patch
---

Update models to include whether they support streaming, and add validation to check whether a model supports streaming
2 changes: 1 addition & 1 deletion docs/providers/ai21.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ main()

| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
| -------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
| jamba-instruct | ✅ | ➖ | ➖ | ➖ | ➖ | ✅ |
| jamba-instruct | ✅ | ✅ | ➖ | ➖ | ➖ | ✅ |

### Legend
| Symbol | Description |
Expand Down
14 changes: 7 additions & 7 deletions docs/providers/anthropic.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -40,13 +40,13 @@ main()

| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
| -------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
| claude-3-5-sonnet-20240620 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
| claude-3-opus-20240229 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
| claude-3-sonnet-20240229 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
| claude-3-haiku-20240307 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
| claude-2.1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| claude-2.0 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| claude-instant-1.2 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| claude-3-5-sonnet-20240620 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
| claude-3-opus-20240229 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
| claude-3-sonnet-20240229 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
| claude-3-haiku-20240307 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
| claude-2.1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| claude-2.0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| claude-instant-1.2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |

### Legend
| Symbol | Description |
Expand Down
38 changes: 19 additions & 19 deletions docs/providers/bedrock.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -42,25 +42,25 @@ main()

| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
| --------------------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
| amazon.titan-text-lite-v1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| amazon.titan-text-express-v1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| anthropic.claude-3-opus-20240229-v1:0 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
| anthropic.claude-3-sonnet-20240229-v1:0 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
| anthropic.claude-3-haiku-20240307-v1:0 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
| anthropic.claude-v2:1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| anthropic.claude-v2 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| anthropic.claude-instant-v1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| cohere.command-r-plus-v1:0 | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
| cohere.command-r-v1:0 | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
| cohere.command-text-v14 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| cohere.command-light-text-v14 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| meta.llama3-8b-instruct-v1:0 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| meta.llama3-70b-instruct-v1:0 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| meta.llama2-13b-chat-v1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| meta.llama2-70b-chat-v1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| mistral.mistral-7b-instruct-v0:2 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| mistral.mixtral-8x7b-instruct-v0:1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| mistral.mistral-large-2402-v1:0 | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
| amazon.titan-text-lite-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| amazon.titan-text-express-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| anthropic.claude-3-opus-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
| anthropic.claude-3-sonnet-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
| anthropic.claude-3-haiku-20240307-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
| anthropic.claude-v2:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| anthropic.claude-v2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| anthropic.claude-instant-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| cohere.command-r-plus-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
| cohere.command-r-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
| cohere.command-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| cohere.command-light-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| meta.llama3-8b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| meta.llama3-70b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| meta.llama2-13b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| meta.llama2-70b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| mistral.mistral-7b-instruct-v0:2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| mistral.mixtral-8x7b-instruct-v0:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| mistral.mistral-large-2402-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |

### Legend
| Symbol | Description |
Expand Down
12 changes: 6 additions & 6 deletions docs/providers/cohere.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -40,12 +40,12 @@ main()

| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
| --------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
| command-r-plus | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
| command-r | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
| command | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| command-nightly | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
| command-light | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| command-light-nightly | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| command-r-plus | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
| command-r | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
| command | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| command-nightly | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
| command-light | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| command-light-nightly | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |

### Legend
| Symbol | Description |
Expand Down
6 changes: 3 additions & 3 deletions docs/providers/gemini.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -40,9 +40,9 @@ main()

| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
| ---------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
| gemini-1.5-pro | ✅ | ➖ | ✅ | ✅ | ✅ | ✅ |
| gemini-1.5-flash | ✅ | ➖ | ✅ | ✅ | ✅ | ✅ |
| gemini-1.0-pro | ✅ | ➖ | ➖ | ➖ | ✅ | ✅ |
| gemini-1.5-pro | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| gemini-1.5-flash | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| gemini-1.0-pro | ✅ | ✅ | ➖ | ➖ | ✅ | ✅ |

### Legend
| Symbol | Description |
Expand Down
10 changes: 5 additions & 5 deletions docs/providers/groq.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -40,11 +40,11 @@ main()

| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
| ------------------ | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
| llama3-8b-8192 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| llama3-70b-8192 | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
| mixtral-8x7b-32768 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| gemma-7b-it | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
| gemma2-9b-it | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
| llama3-8b-8192 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| llama3-70b-8192 | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
| mixtral-8x7b-32768 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| gemma-7b-it | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
| gemma2-9b-it | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |

### Legend
| Symbol | Description |
Expand Down
28 changes: 14 additions & 14 deletions docs/providers/mistral.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -40,20 +40,20 @@ main()

| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
| ----------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
| open-mistral-7b | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
| mistral-tiny-2312 | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
| open-mixtral-8x7b | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| mistral-small-2312 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| open-mixtral-8x22b | ✅ | ➖ | ✅ | ➖ | ✅ | ➖ |
| open-mixtral-8x22b-2404 | ✅ | ➖ | ✅ | ➖ | ✅ | ➖ |
| mistral-small-latest | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
| mistral-small-2402 | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
| mistral-medium-latest | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| mistral-medium-2312 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
| mistral-large-latest | ✅ | ➖ | ✅ | ➖ | ✅ | ➖ |
| mistral-large-2402 | ✅ | ➖ | ✅ | ➖ | ✅ | ➖ |
| codestral-latest | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
| codestral-2405 | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
| open-mistral-7b | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
| mistral-tiny-2312 | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
| open-mixtral-8x7b | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| mistral-small-2312 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| open-mixtral-8x22b | ✅ | ✅ | ✅ | ➖ | ✅ | ➖ |
| open-mixtral-8x22b-2404 | ✅ | ✅ | ✅ | ➖ | ✅ | ➖ |
| mistral-small-latest | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
| mistral-small-2402 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
| mistral-medium-latest | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| mistral-medium-2312 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
| mistral-large-latest | ✅ | ✅ | ✅ | ➖ | ✅ | ➖ |
| mistral-large-2402 | ✅ | ✅ | ✅ | ➖ | ✅ | ➖ |
| codestral-latest | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
| codestral-2405 | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |

### Legend
| Symbol | Description |
Expand Down
Loading

0 comments on commit c449fea

Please sign in to comment.