glide

Install latest/stable of glide

Ubuntu 16.04 or later?

Make sure snap support is enabled in your Desktop store.


Install using the command line

sudo snap install glide

Don't have snapd? Get set up for snaps.

Channel Version Published

🐦 A Lightweight, Cloud-Native LLM Gateway

Glide is an open simple blazing-fast model gateway for rapid development of resilient GenAI applications across multiple modalities (text, speech, vision).

The current features:

  • The routing functionality with four types of routing strategies (including a tricky one like the least latency routing)
  • The first-class adaptive resiliency & fallbacking across all routing strategies
  • Unified Chat API that supports popular model providers like OpenAI, Azure OpenAI (on-prem models), Cohere, OctoML, Anthropic
  • The ability to have model-specific prompts
  • Installation via Docker & Snapcraft & Homebrew

Roadmap: https://github.com/EinStack/glide/blob/develop/ROADMAP.md

Details for glide

License
  • Apache-2.0

Last updated
  • 24 June 2024 - latest/stable
  • 24 June 2024 - latest/edge

Websites

Contact

Source code

Report a bug

Report a Snap Store violation

Share this snap

Generate an embeddable card to be shared on external websites.


Install glide on your Linux distribution

Choose your Linux distribution to get detailed installation instructions. If yours is not shown, get more details on the installing snapd documentation.


Where people are using glide

Users by distribution (log)

Ubuntu 24.04
Ubuntu 22.04