Run local models through a native command-line server and browser console. MLX-Serve provides OpenAI, Anthropic and Ollama-compatible HTTP APIs and downloads models from Hugging Face.
This Linux package requires a supported NVIDIA GPU and host driver 580 or newer. It includes the CUDA runtime and supports amd64 and arm64 systems. The optional system daemon is disabled until explicitly configured.
You are about to open
Do you wish to proceed?
Thank you for your report. Information you provided will help us investigate further.
There was an error while sending your report. Please try again later.
Snaps are applications packaged with all their dependencies to run on all popular Linux distributions from a single build. They update automatically and roll back gracefully.
Snaps are discoverable and installable from the Snap Store, an app store with an audience of millions.
Snap can be installed on Fedora from the command line:
sudo dnf install snapd
Either log out and back in again, or restart your system, to ensure snap’s paths are updated correctly.
To enable classic snap support, enter the following to create a symbolic link between /var/lib/snapd/snap and /snap:
sudo ln -s /var/lib/snapd/snap /snap
To install MLX-Serve, simply use the following command:
sudo snap install mlx-serve
Browse and find snaps from the convenience of your desktop using the snap store snap.
Interested to find out more about snaps? Want to publish your own application? Visit snapcraft.io now.