glide

glide

EinStack Publisher

Install latest/stable of glide

Ubuntu 16.04 or later?

Make sure snap support is enabled in your Desktop store.

Install using the command line

sudo snap install glide

Don't have snapd? Get set up for snaps.

Channel Version Published

🐦 A Lightweight, Cloud-Native LLM Gateway

Glide is an open simple blazing-fast model gateway for rapid development of resilient GenAI applications across multiple modalities (text, speech, vision).

The current features:

  • The routing functionality with four types of routing strategies (including a tricky one like the least latency routing)
  • The first-class adaptive resiliency & fallbacking across all routing strategies
  • Unified Chat API that supports popular model providers like OpenAI, Azure OpenAI (on-prem models), Cohere, OctoML, Anthropic
  • The ability to have model-specific prompts
  • Installation via Docker & Snapcraft & Homebrew

Roadmap: https://github.com/EinStack/glide/blob/develop/ROADMAP.md

Details for glide

License
  • Apache-2.0
Last updated
  • 16 April 2024 - latest/stable
  • 16 April 2024 - latest/edge
Websites
Contact
Source code
Report a bug

Share this snap

Generate an embeddable card to be shared on external websites.

Install glide on your Linux distribution

Choose your Linux distribution to get detailed installation instructions. If yours is not shown, get more details on the installing snapd documentation.

Arch Linux

CentOS

Debian

elementary OS

Fedora

KDE Neon

Kubuntu

Manjaro

Pop!_OS

openSUSE

Red Hat Enterprise Linux

Ubuntu

Raspberry Pi

Where people are using glide

Users by distribution (log)

Ubuntu 22.04
Ubuntu 23.10

Is there a problem with glide? Report this app