MLX-Serve
Install latest/stable of MLX-Serve
Ubuntu 16.04 or later?
Make sure snap support is enabled in your Desktop store.
Details for MLX-Serve
Package name
- mlx-serve
License
- MIT
Last updated
- 3 November 2026 - latest/stable
- 3 November 2026 - latest/candidate
Websites
Contact
Source code
Report a bug
External link warning
You are about to open
Do you wish to proceed?
Report a Snap Store violation
Report MLX-Serve for a Snap Store violation
Snap Store Violation Report submitted successfully
Thank you for your report. Information you provided will help us investigate further.
Error submitting report
There was an error while sending your report. Please try again later.
Share this snap
Generate an embeddable card to be shared on external websites.
Local model inference with OpenAI, Anthropic and Ollama APIs
Run local models through a native command-line server and browser console. MLX-Serve provides OpenAI, Anthropic and Ollama-compatible HTTP APIs and downloads models from Hugging Face.
This Linux package requires a supported NVIDIA GPU and host driver 580 or newer. It includes the CUDA runtime and supports amd64 and arm64 systems. The optional system daemon is disabled until explicitly configured.
| Revision | Channel | Version | Build | Commit | Download SBOM |
|---|
The build and commit information is derived from build infrastructure records.
Install MLX-Serve on your Linux distribution
Choose your Linux distribution to get detailed installation instructions. If yours is not shown, get more details on the installing snapd documentation.
