FreeToken Desktop manages local language models, engine installation, model downloads and an OpenAI-compatible inference server from a native desktop application.
Open FreeToken Desktop and use Install to download its Python engine and CUDA dependencies. Models and the engine are stored under ~/snap/freetoken-desktop/common and require several gigabytes of disk space. Local inference requires a supported NVIDIA GPU and driver.
The desktop can also share the freetoken snap's engine and models instead of downloading a separate engine.
This snap uses the official Linux desktop package. Desktop updates are delivered through the Snap Store.
You are about to open
Do you wish to proceed?
Thank you for your report. Information you provided will help us investigate further.
There was an error while sending your report. Please try again later.
Snaps are applications packaged with all their dependencies to run on all popular Linux distributions from a single build. They update automatically and roll back gracefully.
Snaps are discoverable and installable from the Snap Store, an app store with an audience of millions.
Snap can be installed on Pop!_OS from the command line. Open Terminal from the Applications launcher and type the following:
sudo apt update
sudo apt install snapd
Either log out and back in again, or restart your system, to ensure snap’s paths are updated correctly.
To install FreeToken Desktop, simply use the following command:
sudo snap install freetoken-desktop
Browse and find snaps from the convenience of your desktop using the snap store snap.
Interested to find out more about snaps? Want to publish your own application? Visit snapcraft.io now.