Install latest/stable of llama-cpp
Ubuntu 16.04 or later?
Make sure snap support is enabled in your Desktop store.
You are about to open
Do you wish to proceed?
Thank you for your report. Information you provided will help us investigate further.
There was an error while sending your report. Please try again later.
Generate an embeddable card to be shared on external websites.
llama.cpp packaged as a snap. The main snap ships a CPU build that works on any x86_64 or arm64 machine. Optional snap components add GPU backends:
sudo snap install --edge --devmode llama-cpp # CPU
sudo snap install --edge --devmode llama-cpp+hip # add AMD GPU
sudo snap install --edge --devmode llama-cpp+cuda # add NVIDIA GPU
Select a backend persistently with:
sudo snap set llama-cpp backend={cpu,hip,cuda,auto} # auto = probe
snap get llama-cpp backend
or override it per invocation with the env var:
LLAMA_CPP_BACKEND=cpu llama-cpp cli ...
Choose your Linux distribution to get detailed installation instructions. If yours is not shown, get more details on the installing snapd documentation.
