Skip to content
tezvyn:
Menu

MLOps vs. DevOps: More Than Just "DevOps for ML"

Source: Wikipedia: MLOpsEasyHow cards are made

MLOps vs. DevOps: More Than Just "DevOps for ML"

Think of MLOps as DevOps extended for machine learning. While DevOps automates code deployment, MLOps also handles the unique lifecycle of data and models, including retraining and monitoring for performance decay.

Why it exists

Traditional DevOps pipelines are built for code, which is deterministic. Machine learning systems are not. They are composed of code, data, and a trained model. The model's performance can degrade in production as real-world data changes, a problem called "model drift" that doesn't exist for traditional software. MLOps was created to manage this unique, three-part lifecycle.

The mental model

DevOps is a loop: Plan -> Code -> Build -> Test -> Release -> Deploy -> Operate -> Monitor -> Plan. MLOps is a double loop. It includes the DevOps loop for the application code, but it adds a second, interconnected loop for the model itself: Data Ingestion -> Data Validation -> Model Training -> Model Analysis -> Model Serving -> Model Monitoring -> back to Data Ingestion.

How it works

MLOps introduces new stages and concerns into the CI/CD pipeline. A CI (Continuous Integration) pipeline in MLOps doesn't just run unit tests on code; it also validates new data and may trigger a model retraining job. A CD (Continuous Deployment) pipeline doesn't just deploy a new service; it deploys a new version of a model, often canarying it or A/B testing it against the old one. The "C" in MLOps also stands for "Continuous Training" — automatically retraining models on new data.

When to use it

Use MLOps principles whenever you are putting a machine learning model into a production system. This is especially critical when the model's predictions have a direct business impact and the underlying data patterns are expected to change over time, requiring periodic retraining.

When not to use it

For one-off data analysis or research projects where a model is trained once to generate insights and is never deployed to a live, automated system, a full MLOps pipeline is overkill. Simple scripting and manual tracking are sufficient. It's for production systems, not exploratory analysis.

One canonical example

A recommendation engine on an e-commerce site. DevOps practices manage the application code for the website itself. MLOps practices manage the recommendation model. When new user behavior data comes in, the MLOps pipeline automatically triggers a retraining job. The new model is validated, versioned, and slowly rolled out, with its performance monitored against the old model. If the new model performs worse, the system automatically rolls back.

Interview question

What is the primary distinction that makes MLOps necessary beyond traditional DevOps for machine learning systems?

  • a.Continuously monitoring model performance and orchestrating retraining on new data.Correct
  • b.Automating the build and release process for application code.
  • c.Ensuring that all code changes are thoroughly tested before deployment.
  • d.Providing infrastructure for scalable deployment of services.
Why?

MLOps uniquely addresses the lifecycle of machine learning models and their underlying data, including continuous monitoring for performance decay and automated retraining. Traditional DevOps focuses primarily on the code lifecycle, which is insufficient for the dynamic nature of ML models.

Just read this? Test yourself on what you have been reading.

Read the original → en.wikipedia.org

Put your scrolling time to good use

Learn one idea, try a quiz and save useful cards for revision. Tezvyn makes it easy to learn and stay current in your tech field, a few minutes at a time.

The iPhone app is on the way

We are building it. Until it lands, nothing here is held back from you: every interview card, your saved cards, streaks and the job board all work in Safari, plus hundreds of free practice quizzes of thirty questions each. Sign in and it all carries over to the app the day it arrives.

Want it as an icon? Tap Share at the bottom of Safari, then Add to Home Screen. It opens full screen and the cards you have read stay available offline.

Get it on Google PlayiPhone app coming soon

We are hiring for this. Open roles that interview on mlops — each one lists the topics its interview covers.

See open roles