Lemonade Server is a lightweight, high-performance local AI inference server that provides an OpenAI-compatible API for running large language models on your own hardware.
Features:
Supported Hardware:
Quick Start: The server starts automatically after installation. Access the API at: http://localhost:8000/api/v1
ROCm Support (AMD GPUs): For ROCm GPU acceleration, connect the process-control interface: sudo snap connect lemonade-server:process-control
Documentation: https://lemonade-server.ai/
You are about to open
Do you wish to proceed?
Thank you for your report. Information you provided will help us investigate further.
There was an error while sending your report. Please try again later.
Snaps are applications packaged with all their dependencies to run on all popular Linux distributions from a single build. They update automatically and roll back gracefully.
Snaps are discoverable and installable from the Snap Store, an app store with an audience of millions.
Snapd can be installed from Manjaro’s Add/Remove Software application (Pamac), found in the launch menu. From the application, search for snapd, select the result, and click Apply.
Alternatively, snapd can be installed from the command line:
sudo pacman -S snapd
Once installed, the systemd unit that manages the main snap communication socket needs to be enabled:
sudo systemctl enable --now snapd.socket
To enable classic snap support, enter the following to create a symbolic link between /var/lib/snapd/snap and /snap:
sudo ln -s /var/lib/snapd/snap /snap
Either log out and back in again, or restart your system, to ensure snap’s paths are updated correctly.
To install Lemonade Server, simply use the following command:
sudo snap install lemonade-server
Browse and find snaps from the convenience of your desktop using the snap store snap.
Interested to find out more about snaps? Want to publish your own application? Visit snapcraft.io now.