AI-Accelerated Product Development
General Pipeline Design
Total time needed:
With this recipe, you will learn what is a ML pipeline and how to design a general ML pipeline.
Potential Use Cases
When you have a ML model and you want to deploy it to production, this recipe can help you understand what is the end-to-end ML pipeline looks like.
Who is This For ?
Practitioner in ML fields.
Click on each of the following
to see details.
1. What Is a Machine Learning Pipeline?
What is a machine learning pipeline?
What are the benefits of a machine learning Pipeline?
What to consider when building a machine learning pipeline?
2. What is an ML pipeline and why is it important?
Why pipelining is so important?
How ML pipelines benefit performance and organization?
What are the use cases of an ML pipeline?
What are the challenges of an ML pipeline?
3. Architecting a Machine Learning Pipeline
What are the things that a production-ready ML system should try to address?
How to architect a ML pipeline?
4. Building Machine Learning Pipelines
Why Machine Learning Pipelines?
When to Think About Machine Learning Pipelines?
Overview of the Steps in a Machine Learning Pipeline?
Our Example Project?
5. Building-ML-Pipelines / building-machine-learning-pipelines
Example of a ML pipeline?
6. Workflow Tools for ML Pipelines
What is a batch model pipeline looks like?
7. A Complete Introduction to Apache Airflow
8. Managed Apache Airflow on AWS — New AWS Service For Data Pipelines
9. MLOps: Continuous delivery and automation pipelines in machine learning