Meet 🐦 Glide, an open blazing-fast model gateway to speed up your GenAI app development and make your LLM apps production ready 🚀
Glide strives to help you to solve common problems that occur during development and running GenAI apps by moving them out of your specific applications on the level of your infrastructure. All you need to do to start leveraging that is to talk to your models via Glide ✨
As a part of this initial scope, we had to set up a bunch of common things to make it roll. As for the core functionality, we have brought up:
- The routing functionality with four types of routing strategies (including a tricky one like the least latency routing)
- The first-class adaptive resiliency & fallbacking across all routing strategies
- Unified Chat API that supports popular model providers like OpenAI, Azure OpenAI (on-prem models), Cohere, OctoML, Anthropic
- The ability to have model-specific prompts
- Installation via Docker & Homebrew
The most exciting things are ahead of us, so looking forward to get more cool stuff in scope of Public Preview 🚀 🚀 🚀
If you like the idea, feel free to give us a star, join our Discord and watch for our upcoming releases.
Let's equip GenAI revolution with a resilient open infrastructure together 🙌
📦 Release: https://lnkd.in/ezD4jtNj
📚 Docs: https://glide.einstack.ai/
📺 Demo: https://lnkd.in/eaySzQQz
💬 Discord: https://lnkd.in/e6_zFSWf
🗺️ Roadmap: https://lnkd.in/eicCXdQc
#genai #llmops #llm #llmsecurity #mlops #datascience #machinelearning #cncf
Member of Technical Staff at OpenAI | ex Covariant, Google/YouTube
2moThis has been awesome to watch. That's for making our SDKs the best in the industry!