Infrastructure
The Engineer's Guide to MLOps: Automating the Machine Learning Lifecycle
A comprehensive guide to the principles, practices, and tools for streamlining the machine learning lifecycle from model development to production deployment and monitoring.
MLOps, or Machine Learning Operations, is the application of DevOps principles to the entire machine learning (ML) lifecycle to automate and standardize model development and deployment. Unlike traditional software, ML systems have a dual dependency on both code and data, introducing unique complexities such as data versioning, experiment tracking, and model retraining. The primary goal of MLOps is to bridge the gap between ML model development and IT operations, enabling faster, more reliable, and reproducible delivery of ML-powered applications.
A mature MLOps workflow encompasses several core stages: data management (ingestion, validation, versioning), model development (experiment tracking, automated training pipelines), model deployment (CI/CD for models, various serving strategies like canary or A/B testing), and continuous monitoring (tracking performance, detecting data/concept drift, and triggering retraining). By implementing these practices, engineering teams can manage the inherent complexities of ML systems, reduce technical debt, and ensure that models in production continue to deliver value as real-world conditions evolve.
Latest briefings on The Engineer's Guide to MLOps: Automating the Machine Learning Lifecycle
Infra
New AWS Agent Finds and Fixes Cloud Overspending
AWS has launched a new managed service called FinOps Agent. It automatically investigates cost spikes, finds the cause, and sends alerts to the right teams through tools like Slack and Jira to help control cloud spending.
Ashish Kale ·
AI
A Normal-Looking Image Can Jailbreak AI Models
Researchers found a way to jailbreak vision-language AI models using tiny, invisible changes to images. This new attack method bypasses standard safety filters that only analyze text prompts, creating a significant new security risk.
Neeraj Dhiman ·
AI
How an Engineer Used AI to Find Security Flaws
A software engineer used GitHub Copilot, Claude, and Gemini to find security vulnerabilities in the ClickHouse codebase. This practical case study shows how AI can help developers without deep security expertise improve software security.
Neeraj Dhiman ·
Infra
Argo CD Now Verifies Your Code’s Origin
The popular cloud deployment tool Argo CD is getting a major security boost. Its latest update adds features to verify that your code is authentic and to encrypt internal traffic, helping to secure your software supply chain.
Ashish Kale ·
Infra
Get a Clearer View of Your Kubernetes AI Jobs
A new plugin for the Headlamp Kubernetes UI now supports Volcano, a popular batch scheduler for AI and high-performance computing. This gives developers a simple web interface to inspect and manage complex batch jobs directly within Kubernetes.
Ashish Kale ·
Infra
Secure Remote Access Just Got a Replay Button
HashiCorp's Boundary 1.0 is now production-ready, adding a key feature: RDP session recording. This helps security and IT teams monitor remote desktop access and meet strict compliance and audit requirements.
Ashish Kale ·
Infra
Cloudflare Fixed a Bug That Stalled New Connections
Cloudflare discovered a subtle bug in its open-source QUIC code that failed to handle heavy packet loss at the start of a connection. The fix improves network reliability for services using their modern protocol implementation.
Ashish Kale ·
Tech
Samsara Gives Heavy Equipment a 360-Degree View
Samsara has launched a new 360 camera for heavy equipment. The system uses AI to give operators a complete view of their surroundings, aiming to make crowded industrial sites and factories safer for everyone.
Navdeep Kaur Mahal ·
Data
New Silk Runtime Slashes ClickHouse Latency
ClickHouse has released Silk, a new open-source C++ runtime. It uses advanced techniques to dramatically lower query latency and improve performance, making the database more efficient for demanding workloads.
Taranpreet Singh ·
AI
Salesforce AI Agent Only Charges for Solved Problems
Salesforce launched a new AI help agent with a novel pricing model. Companies will only pay when the AI successfully resolves a customer issue, directly linking support costs to its actual performance and value.
Neeraj Dhiman ·
Infra
Cloudflare Tool Migrates Security Setups in Hours
Cloudflare has released a new open-source tool to help companies move to its Zero Trust security platform. It includes automated logic to migrate from competitors like Zscaler and Palo Alto Networks, cutting migration times from months to hours.
Ashish Kale ·
Data
Keep Your Old PostgreSQL Database Secure for Longer
A new service from PGX offers security patches and bug fixes for old, unsupported versions of PostgreSQL. This helps companies that can't upgrade stay secure and maintain data integrity without a costly migration.
Taranpreet Singh ·
AI
Why Slack Moved Its AI to Multiple Clouds
Slack shared its four-phase journey from a single-cloud AI setup to a multi-cloud platform using both AWS Bedrock and Google Vertex AI. The move offers a valuable roadmap for companies seeking more flexible and resilient AI infrastructure.
Neeraj Dhiman ·
Infra
AWS Launches First Cloud Servers with PCIe 6.0
AWS is now the first cloud provider to offer servers with PCIe 6.0, beating rivals like Intel and AMD to the milestone. The new Graviton5 instances provide significantly faster data transfer for demanding workloads.
Ashish Kale ·
Data
Visa Cut Data Reporting From Days to Seconds
Visa built a conversational AI agent using ClickHouse and LibreChat to analyze payments data. The new system turns multi-day reporting tasks into sub-second queries, saving each user up to 10 hours of work every week.
Taranpreet Singh ·
Infra
Cloudflare Replaces API Tokens with Secure Logins
Cloudflare now lets all developers use OAuth for third-party app integrations. This offers a more secure alternative to traditional API tokens, giving users granular control over what data and actions an application can access.
Ashish Kale ·
AI
New AI Model Creates Enterprise Images in Seconds
Krea AI has released Krea 2, an open-weight image model that generates enterprise-grade visuals in two seconds. It aims to solve the problem of generic "AI slop" with a custom license for commercial use.
Neeraj Dhiman ·
Tech
Ukraine Open-Sources Captured Russian Military Technology
Ukraine's Ministry of Defence has launched TrophyLab, a new platform open-sourcing intelligence on captured Russian military hardware. Verified allies can access technical data, schematics, and even request physical samples to develop countermeasures.
Taranpreet Singh ·
Infra
AI Is Turning Developers Into Code Validators
A new GitLab report finds AI code tools are turning developers into validators, not just writers. This shift creates new risks, as teams struggle to control the quality and security of code they didn't write.
Ashish Kale ·
Tech
New Visual Editor Tames Complex LaTeX Diagrams
A new open-source tool provides a visual, 'what you see is what you get' interface for TikZ, a powerful but difficult LaTeX package. This simplifies creating complex diagrams for technical papers and documentation.
Navdeep Kaur Mahal ·
Infra
Find and Fix Workflow Bugs Faster on Vercel
Vercel has launched a redesigned trace viewer for its Workflows tool. The update helps developers debug complex processes more quickly by making it easier to search, zoom, and inspect each step of a workflow run.
Ashish Kale ·
Tech
AI Is Now Conducting Video Job Interviews
A Stockholm startup just raised $4M for its hiring platform where AI agents conduct video interviews. The company combines AI screening with short-form video profiles, aiming to create a TikTok-style experience for recruitment.
Taranpreet Singh ·
Infra
Why Azure Says Stop Blaming People for Outages
A post-mortem of Azure's 2023 global outage reveals a crucial lesson: "human error" is a myth. Engineering leaders should instead focus on fixing systemic flaws to build truly resilient systems and protect their teams from blame.
Ashish Kale ·
Tech
A New Self-Hosted Alternative to Frame.io
A new open-source tool called Shumai offers a self-hosted alternative to Frame.io. It helps creative teams manage files, projects, and feedback, giving them more control over their workflow and data.
Taranpreet Singh ·
Infra
Azure Kubernetes Now Runs Demanding AI and Bare Metal
Microsoft has updated its Azure Kubernetes Service with new features for AI, bare metal servers, and managing multiple clusters. This helps teams run more demanding applications and simplifies large-scale operations on the cloud.
Ashish Kale ·
Tech
NASA Launchpads Are Too Old for Modern Rockets
A new report finds NASA's Kennedy Space Center infrastructure is too old to support the growing number of launches from SpaceX and Blue Origin. This bottleneck could delay critical missions and impact the entire space-tech industry.
Taranpreet Singh ·
Infra
Vercel Wants to Replace Your Feature Flag Tool
Vercel has launched its own feature flagging tool, built directly into its platform. This gives developers a native way to safely roll out new features and test changes, potentially replacing third-party services like LaunchDarkly.
Ashish Kale ·
AI
Cursor Acquires Open-Source Copilot Rival Continue
AI code editor Cursor has acquired Continue, an open-source alternative to GitHub Copilot. The move signals further consolidation in the competitive market for AI-powered developer tools, reducing the number of independent players.
Neeraj Dhiman ·
Infra
Vercel Now Lets You Build Real-Time Apps
Vercel now supports WebSockets in its serverless functions, a long-requested feature. This allows developers to build real-time applications like live chats and collaborative tools directly on the platform, paying only for active processing time.
Ashish Kale ·
Infra
Old Pixel Phones Power a New Private Cloud
Google and UC San Diego are building a private cloud using 2,000 retired Pixel phones. This project explores a sustainable, low-cost way to create computing infrastructure and reduce electronic waste from discarded smartphones.
Ashish Kale ·
Frequently asked questions
What is MLOps and how does it differ from DevOps?
MLOps (Machine Learning Operations) adapts DevOps principles for the machine learning lifecycle. While both emphasize automation and CI/CD, MLOps addresses unique ML challenges like data and model versioning, experiment tracking, and continuous training (CT) to combat model drift, which are not primary concerns in traditional software DevOps.
What are the key stages in a typical MLOps pipeline?
An MLOps pipeline automates the ML lifecycle, typically including stages for data ingestion and validation, feature engineering, model training and evaluation, model packaging and registration, and finally, deployment and monitoring. The goal is to create a reproducible and robust system for moving models from experimentation to production.
What is 'model drift' and how does MLOps help manage it?
Model drift is the degradation of a model's predictive accuracy over time due to changes in the statistical properties of the input data. MLOps addresses this through continuous monitoring of model performance and data distributions, with automated pipelines to trigger retraining and redeployment on new data when significant drift is detected.
What are some common open-source tools used for MLOps?
The MLOps ecosystem features a variety of tools, such as DVC for data versioning, MLflow for experiment tracking and model management, Kubeflow or Airflow for orchestrating complex pipelines, and KServe or Seldon Core for scalable model serving on Kubernetes. These tools are often combined to build comprehensive MLOps platforms.