Client side scripts in a snap to submit Apache Spark jobs to a Kubernetes cluster.
Apache Spark is a multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters.
Canonical's Charmed solution for Apache Spark runs Spark jobs on your Kubernetes cluster. The spark-client snap includes the scripts spark-submit, spark-shell, pyspark and other tools for managing Apache Spark jobs for Kubernetes.
Enable snaps on Raspberry Pi and install spark-client
Snaps are applications packaged with all their dependencies to run on all popular Linux distributions from a single build. They update automatically and roll back gracefully.
Snaps are discoverable and installable from the Snap Store, an app store with an audience of millions.
Enable snapd
On a Raspberry Pi running the latest version of Raspbian snap can be installed directly from the command line:
sudo apt update
sudo apt install snapd
You will also need to reboot your device:
sudo reboot
After this, install the snapd snap in order to get the latest snapd:
sudo snap install snapd
Install spark-client
To install spark-client, simply use the following command: