Install latest/stable of Lemonade Server
Ubuntu 16.04 or later?
Make sure snap support is enabled in your Desktop store.
Install using the command line
sudo snap install lemonade-server
Don't have snapd? Get set up for snaps.
You are about to open
Do you wish to proceed?
Thank you for your report. Information you provided will help us investigate further.
There was an error while sending your report. Please try again later.
Generate an embeddable card to be shared on external websites.
Lemonade Server is a lightweight, high-performance local AI inference server that provides an OpenAI-compatible API for running large language models on your own hardware.
Features:
Supported Hardware:
Quick Start: The server starts automatically after installation. Access the API at: http://localhost:8000/api/v1
ROCm Support (AMD GPUs): For ROCm GPU acceleration, connect the process-control interface: sudo snap connect lemonade-server:process-control
Documentation: https://lemonade-server.ai/
Choose your Linux distribution to get detailed installation instructions. If yours is not shown, get more details on the installing snapd documentation.