djl-bench is a command line tool that allows you to benchmark the
model on all different platforms for single-thread/multi-thread
inference performance.
Currently djl-bench support the models from the following framework:
Snaps are applications packaged with all their dependencies to run on all popular Linux distributions from a single build. They update automatically and roll back gracefully.
Snaps are discoverable and installable from the Snap Store, an app store with an audience of millions.
Enable snapd
On Debian 9 (Stretch) and newer, snap can be installed directly from the command line: