Kaggle’s Corona Hack Challenge
About
The Kaggle Corona-Hack Chest X-Ray problem is a popular Data Science topic. In this course, you will explore how to solve this problem with Kubeflow. In addition, you’ll learn how the work you are doing is the foundation for an effective and self-sustainable MLOps culture and platform solution that you can undertake at your enterprise.
In this course, you will run a PyTorch distributed training job starting from your notebook. The Kubeflow PyTorch operator is a Kubeflow component that can orchestrate PyTorch deep learning distributed jobs. In order to describe and submit such a job, you would normally need to write a PyTorchJob CR (YAML file), providing run configurations and the containers with which the Pods will run. Besides writing this YAML file, you would also need to build a Docker image for the Pods and make sure your data is available to them as well. Fortunately, all of this now comes automated in Kale.
This course is approximately 90 minutes long.
In this course, you will:
- Learn about Kaggle.
- Learn about Kubeflow.
- Learn about MLOps.
- Use Jupyter Notebooks in Kubeflow to review the Kaggle OpenVaccine Problem Solution.
- Use Kale to convert a Jupyter notebook into a Kubeflow pipeline.
- Use the Kubeflow PyTorch operator to orchestra PyTorch deep learning.
- Perform PyTorch deep learning as a distributed job.
- Relate the activities in this course back to the core tenents of MLOps.
Requirements
Arrikto Academy assumes that you have familiarity with popular Data Science concepts and have used some of these philosophies in practice.