From notebooks to pipelines with Kubeflow KALE
aymen frikha
on 28 July 2021
Tags: AI/ML , deep learning , Kale , Kubeflow , kubernetes , machine learning
What is Kubeflow?
Kubeflow is the open-source machine learning toolkit on top of Kubernetes. Kubeflow translates steps in your data science workflow into Kubernetes jobs, providing the cloud-native interface for your ML libraries, frameworks, pipelines and notebooks.
Notebooks in Kubeflow
Within the Kubeflow dashboard, data scientists can spin up for their data preparation and model development.
Upon creating the fun88体育, users can select among default images, or use a custom image, including one with pre-installed KALE.
What is Kubeflow KALE?
KALE (Kubeflow Automated pipeLines Engine) extends notebooks within Kubeflow in order to allow for automated pipeline creation.
All you have to do is to annotate cells (pieces of your code) within your Jupyter notebook and these tags will be automatically translated into your Kubeflow Pipeline.
You can tag a cell as a component or block indicating that the code within represents a step in your pipeline, and indicate the dependencies of that step (pre: <dependency-name>).
DEMO: Using KALE with Charmed Kubeflow, ElasticSearch and Ceph
In this demo, an Elasticsearch cluster will be used as a data store, a Ceph cluster as object storage to store the resulting models, and a Kubeflow environment is used as a data scientist platform to develop the AI algorithm as well as run the pipeline.
The following diagram shows an overview of the environment:
To set up the environment demo, you can follow the steps mentioned in this .
To set up the environment demo, you can follow the steps mentioned in this .
After setting up the environment and making sure that everything is running, we can now open a sshuttle tunnel (or an SSH forward) from your machine to the AWS instance using this command:
$ sshuttle -r ubuntu@<EC2 public ip> 10.64.140.43/24
Then we access the Kubeflow dashboard and create a new Jupyter notebook with the Kale container image. We will use the following parameters for the notebook demo:
Name: kale-demo
Custom image: localhost:32000/kale-demo
CPU: 1
MEM: 2 Gi
In a new terminal within this notebook we need to download the financial time series demo notebook:
$ wget
We need to do some changes to the following notebook parameters that reflect the current environment:
- The endpoint_url (IP of the ceph-radosgw unit)
- The access_key (access key for the ceph user: from ./create-rados-user.sh output)
- The secret_key (secret key for the ceph user: from ./create-rados-user.sh output)
- The elastic_url (IP of the elastic unit)
Now we can enable Kale for this notebook and, in the advanced settings, we need to change the docker image to “localhost:32000/kale-demo”
Then we can run the Kubeflow pipeline by hitting the button compile and run.
This will compile and run your Kubeflow pipeline.
Finally, if you click on View, you will be redirected to the specific pipeline run just created.
Serving models on Kubernetes
Enterprise computing is moving to Kubernetes, and Kubeflow has long been talked about as the platform to solve MLOps at scale.
KFServing, the model serving project under Kubeflow, has shown to be the most mature tool when it comes to open-source model deployment tooling on K8s, with features like canary rollouts, multi-framework fun88体育less inferencing and model explainability.
Learn more about KFServing in What is KFServing?
Learn more about MLOps
Canonical provides MLOps & Kubeflow training for enterprises alongside professional services such as security and support, custom deployments, consulting, and fully managed Kubeflow – read Ubuntu’s AI services page for details.
Simplify your Kubeflow operations
Get the latest Kubeflow packaged in , providing composability, day-0 and day-2 operations for all Kubeflow applications including KFServing.
With Charmed Kubeflow, deployment and operations of Kubeflow are easy for any scenario.
Charmed Kubeflow is a collection of Python operators that define integration of the apps inside Kubeflow, like
katib or pipelines-ui.
Use Kubeflow on-prem, desktop, edge, public cloud and multi-cloud.
What is Kubeflow?
Kubeflow makes deployments of Machine Learning workflows on Kubernetes simple, portable and scalable.
Kubeflow is the machine learning toolkit for Kubernetes. It extends Kubernetes ability to run independent and
configurable steps, with machine learning specific frameworks and libraries.
Install Kubeflow
The Kubeflow project is dedicated to making deployments of machine learning workflows on Kubernetes simple,
portable and scalable.
You can install Kubeflow on your workstation, local fun88体育 or public cloud VM. It is easy to install
with MicroK8s on any of these environments and can be scaled to high-availability.