Discover, install and connect to inference models on Ubuntu — from one place.

Inference Manager from Canonical brings provider management and model access together. Use the command line to manage inference snaps, and connect your applications to a single endpoint that routes requests to the providers running on your machine.

Inference Manager allows you to:

• Discover available inference providers and inspect their models and engines.
• Install and remove inference snaps from the command line.
• List models available through the inference proxy.
• Check service status and provider health.
• Send inference requests through a single local endpoint.

Get started

• Install: snap install inference
• Discover providers: inference find
• Install an optimized provider: inference install gemma4
• Explore models: inference models
• Integrate your agent: curl http://localhost:8400/v1/models (OpenAI and SystemOne)

Use snap get|set inference to view and modify configurations.