v0.0.1 (Private Preview) 🎉
This is the first "stable" release of Glide gateway as we have finished our Private Preview milestone 🎉🎉🎉
As a part of this initial scope, we had to setup a bunch of common things to make it roll. As for the core functionality, we have brought up:
- The routing functionality with four types of routing strategies (including a tricky one like the least latency routing)
- The first-class adaptive resiliency & fallbacking across all routing strategies
- Unified Chat API that supports popular model providers like OpenAI, Azure OpenAI (on-prem models), Cohere, OctoML, Anthropic
- The ability to have model-specific prompts
- Installation via Docker & Homebrew
The most exciting things are ahead of us, so looking forward to get more cool stuff in scope of Public Preview 🚀 🚀 🚀
Let's equip GenAI revolution with a resilient open infrastructure 🙌
📦 Release: https://github.com/EinStack/glide/releases/tag/0.0.1
📚 Docs: https://glide.einstack.ai/
📺 Demo: https://github.com/EinStack/glide-demo
🗺️ Roadmap: https://github.com/EinStack/glide/blob/develop/ROADMAP.md
Changelog
Features
- ✨ #81: Allow to chat message based for specific models (@mkrueger12)
Improvements
- 🔧 #78: Normalize response latency by response token count (@roma-glushko)
- 📝 #112 added the CLI banner info (@roma-glushko)
Miscellaneous
- 📝 #114 Make links actual across the project (@roma-glushko)