Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Lang] Integrate Cohere with Chat Streaming #171

Closed
roma-glushko opened this issue Mar 13, 2024 · 0 comments · Fixed by #189
Closed

[Lang] Integrate Cohere with Chat Streaming #171

roma-glushko opened this issue Mar 13, 2024 · 0 comments · Fixed by #189
Assignees
@mkrueger12
Labels
area:providers good first issue Good for newcomers help wanted Extra attention is needed model:language provider:cohere size:small

Comments

@roma-glushko
Copy link
Member

Reference:
@mkrueger12 mkrueger12 assigned mkrueger12 and unassigned mkrueger12 Mar 22, 2024
@mkrueger12 mkrueger12 linked a pull request Mar 22, 2024 that will close this issue
✨ #171: Cohere Streaming Chat Support #189
Merged
mkrueger12 added a commit that referenced this issue Mar 22, 2024
@mkrueger12
#171: support streaming
b5388b9
mkrueger12 added a commit that referenced this issue Mar 24, 2024
@mkrueger12
#171: add tests & lint
8c969df
mkrueger12 added a commit that referenced this issue Mar 24, 2024
@mkrueger12
#171: update chat.go
0a50c1a
mkrueger12 added a commit that referenced this issue Mar 24, 2024
@mkrueger12
#171: lint
215792d
mkrueger12 added a commit that referenced this issue Mar 24, 2024
@mkrueger12
#171: update test
b342d18
mkrueger12 added a commit that referenced this issue Mar 26, 2024
@mkrueger12
✨ #171: Cohere Streaming Chat Support (#189)
f76eb86 
* #171: support streaming

* #171: add tests & lint

* #171: update chat.go

* #171: lint

* #171: update test

---------

Co-authored-by: Max <[email protected]>
@roma-glushko roma-glushko mentioned this issue Apr 7, 2024
Merged
roma-glushko added a commit that referenced this issue Apr 7, 2024
@roma-glushko
📦 Release: v0.0.3-rc1 (#192)
5e0dd0f 
A new release candidate that includes the new streaming chat functionality.

### Added

- ✨Streaming Chat Workflow #149 #163 #161 (@roma-glushko)
- ✨Streaming Support for Azure OpenAI #173 (@mkrueger12)
- ✨Cohere Streaming Chat Support #171 (@mkrueger12)
- ✨Start counting token usage in Anthropic Chat #183 (@roma-glushko)
- ✨Handle unauthorized error in health tracker #170 (@roma-glushko)

### Fixed

- 🐛 Fix Anthropic API key header #183 (@roma-glushko)

### Security

-  🔓 Update crypto lib, golang, fiber #148 (@roma-glushko)

### Miscellaneous

-  🐛 Update README.md to fix helm chart location #167 (@arjunnair22)
- 🔧 Updated .go-version (@roma-glushko)
-  ✅ Covered the telemetry by tests #146 (@roma-glushko)
- 📝 Separate and list all supported capabilities per provider #190 (@roma-glushko)
@roma-glushko roma-glushko mentioned this issue Apr 16, 2024
Merged
roma-glushko added a commit that referenced this issue Apr 16, 2024
@roma-glushko
📦 v0.0.3 (#215)
754af34 
## Summary

✨ Bringing support for streaming chat in Glide (integrated with OpenAI, Azure OpenAI and Cohere)
✨ Started handling 401 errors to mark models as premaritally unavailable (e.g. when API key was not correct)
🐛 Fixing the panic related to swagger.yaml file
🐛 Fixing Anthropic chat workflow by passing API key correctly
🔧 Improved Cohere param config and validation

## Changelog

### Added

- ✨Streaming Chat Workflow #149 #163 #161 (@roma-glushko)
- ✨Streaming Support for Azure OpenAI #173 (@mkrueger12)
- ✨Cohere Streaming Chat Support #171 (@mkrueger12)
- ✨Start counting token usage in Anthropic Chat #183 (@roma-glushko)
- ✨Handle unauthorized error in health tracker #170 (@roma-glushko)
- 🔧 #195 #196: Set router ctx in stream chunks & handle end of stream in case of some errors (@roma-glushko)
- 🐛🔧 #197: Handle max_tokens & content_filtered finish reasons across OpenAI, Azure and Cohere (@roma-glushko)

## Changed

- 🔧 💥 #198: Expose more Cohere params & fixing validation of provider params in config (breaking change) (@roma-glushko)
- 🔧 #186: Rendering Durations in a human-friendly way (@roma-glushko)

### Fixed

- 🐛 Fix Anthropic API key header #183 (@roma-glushko)
- 🐛 #209: Embed Swagger specs into binary to fix panics caused by missing swagger.yaml file (@roma-glushko)
- 🐛 #200: Implemented a custom json per line stream reader to read Cohere chat streams correctly (@roma-glushko)

### Security

-  🔓 Update crypto lib, golang, fiber #148 (@roma-glushko)

### Miscellaneous

-  🐛 Update README.md to fix helm chart location #167 (@arjunnair22)
- 🔧 Updated .go-version (@roma-glushko)
-  ✅ Covered the telemetry by tests #146 (@roma-glushko)
- 📝 Separate and list all supported capabilities per provider #190 (@roma-glushko)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mkrueger12 mkrueger12

Labels
area:providers good first issue Good for newcomers help wanted Extra attention is needed model:language provider:cohere size:small
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

✨ #171: Cohere Streaming Chat Support EinStack/glide
2 participants
@roma-glushko @mkrueger12