llama-cpp
Install latest/stable of llama-cpp
Ubuntu 16.04 or later?
Make sure snap support is enabled in your Desktop store.
Details for llama-cpp
Package name
- llama-cpp
License
- MIT
Last updated
- 10 November 2026 - latest/stable
- 3 November 2026 - latest/candidate
Source code
Report a bug
External link warning
You are about to open
Do you wish to proceed?
Report a Snap Store violation
Report llama-cpp for a Snap Store violation
Snap Store Violation Report submitted successfully
Thank you for your report. Information you provided will help us investigate further.
Error submitting report
There was an error while sending your report. Please try again later.
Share this snap
Generate an embeddable card to be shared on external websites.
Snap package for llama.cpp - LLM inference in C/C++
llama.cpp packaged as a snap. The main snap ships a CPU build that works on any x86_64 or arm64 machine. Optional snap components add GPU backends:
sudo snap install llama-cpp # CPU sudo snap install llama-cpp+hip # add AMD GPU sudo snap install llama-cpp+cuda # add NVIDIA GPU sudo snap install llama-cpp+vulkan # add Vulkan GPU (Intel, AMD, etc.) sudo snap install llama-cpp+opencl # add OpenCL GPU (Adreno, Mali, etc.) sudo snap install llama-cpp+sycl # add SYCL GPU (Intel)
Select a backend persistently with:
sudo snap set llama-cpp backend={cpu,hip,cuda,vulkan,opencl,sycl,auto} # auto = probe snap get llama-cpp backend
or override it per invocation with the env var:
LLAMA_CPP_BACKEND=cpu llama-cpp cli ...
The llama.cpp web server can also be run using the llama-cpp.server app. This is disabled by default but can be enabled by running:
snap start --enable llama-cpp.server
By default, no additional arguments are passed to the server, meaning it will listen on the default port and address. Arguments can be specified by setting the server-opts configuration value, e.g.:
snap set llama-cpp server-opts="--host 0.0.0.0"
Afterwards, the server must be restarted for the new arguments to take effect:
snap restart llama-cpp.server
| Revision | Channel | Version | Build | Commit | Download SBOM |
|---|
The build and commit information is derived from build infrastructure records.
Install llama-cpp on your Linux distribution
Choose your Linux distribution to get detailed installation instructions. If yours is not shown, get more details on the installing snapd documentation.
