Install latest/stable of HP Z Runtime
Ubuntu 16.04 or later?
Make sure snap support is enabled in your Desktop store.
Install using the command line
sudo snap install zrt --classicDon't have snapd? Get set up for snaps.
You are about to open
Do you wish to proceed?
Thank you for your report. Information you provided will help us investigate further.
There was an error while sending your report. Please try again later.
Generate an embeddable card to be shared on external websites.
zrt is a command-line tool that wraps vLLM to provide a streamlined experience for serving large language models on Linux. It handles environment setup, model lifecycle management, and exposes an OpenAI-compatible HTTP API - making it easy to pull, serve, and observe LLM workloads with a few simple commands.
Designed for Linux servers with GPU workloads, zrt is useful for developers and teams who want a production-ready alternative to Ollama backed by the vLLM inference engine.
For documentation, visit our zdocs page at https://zdocs.datascience.hp.com/docs/zruntime/overview
Found an issue? Have a feature request? Open an issue at https://github.com/HPInc/zrt-support
| Revision | Channel | Version | Build | Commit |
|---|
The build and commit information is derived from build infrastructure records.
Choose your Linux distribution to get detailed installation instructions. If yours is not shown, get more details on the installing snapd documentation.
