zrt is a command-line tool that wraps vLLM to provide a streamlined experience for serving large language models on Linux. It handles environment setup, model lifecycle management, and exposes an OpenAI-compatible HTTP API - making it easy to pull, serve, and observe LLM workloads with a few simple commands.
Designed for Linux servers with GPU workloads, zrt is useful for developers and teams who want a production-ready alternative to Ollama backed by the vLLM inference engine.
For documentation, visit our zdocs page at https://zdocs.datascience.hp.com/docs/zruntime/overview
Found an issue? Have a feature request? Open an issue at https://github.com/HPInc/zrt-support
You are about to open
Do you wish to proceed?
Thank you for your report. Information you provided will help us investigate further.
There was an error while sending your report. Please try again later.
Snaps are applications packaged with all their dependencies to run on all popular Linux distributions from a single build. They update automatically and roll back gracefully.
Snaps are discoverable and installable from the Snap Store, an app store with an audience of millions.
Snap can be installed from the command line. Open the Konsole terminal and enter the following:
sudo apt update
sudo apt install snapd
To install HP Z Runtime, simply use the following command:
sudo snap install zrt --classic
Browse and find snaps from the convenience of your desktop using the snap store snap.
Interested to find out more about snaps? Want to publish your own application? Visit snapcraft.io now.