MLOps Engineer

Evlo AI; Boston (MA); On-site; USD 150,000 - 190,000; Full time

Job summary

Evlo AI seeks an experienced MLOps Platform Engineer to own the infrastructure turning experimental ML work into production systems. You will design and operate CI/CD pipelines, model serving, and observability for reliable, scalable ML workflows.

You will collaborate with ML engineers and data scientists to reduce friction between notebooks and production, implement IaC with Terraform or Pulumi, and optimize cloud costs while ensuring reproducibility and governance.

Qualifications

• 3–6 years of MLOps/DevOps or platform engineering experience.
• Production ML systems support with cloud infrastructure.
• Proficient Python and/or Go development for automation.
• Experience with observability tooling and IaC practices.

Responsibilities

• Design and maintain CI/CD pipelines for ML workflows.
• Build and operate model serving infrastructure on Kubernetes.
• Implement monitoring, latency, drift detection, and alerting.
• Develop feature stores and data pipeline integrations.
• Optimize training and inference costs across clouds.
• Establish MLOps best practices and infrastructure-as-code standards.
• Collaborate with ML engineers to debug production incidents.

Skills

MLOps experience

DevOps experience

Platform engineering

Education

Bachelor’s degree in Computer Science or Engineering

Tools

Kubernetes

Docker

Terraform

Pulumi

Job description

About The Role

The role owns the infrastructure that turns experimental ML work into reliable production systems - CI/CD for models, scalable training infrastructure, real-time and batch serving, and the observability tooling that keeps it all running.

You will work directly with ML engineers and data scientists to eliminate the friction between 'it works in a notebook' and 'it works at scale', owning the platform decisions that determine how fast models ship and how reliably they perform.

Key Responsibilities

• Design and maintain CI/CD pipelines for ML workflows using tools like Kubeflow, MLflow, or Argo Workflows, from model versioning through automated deployment
• Build and operate model serving infrastructure on Kubernetes, including GPU scheduling, autoscaling, canary deployments, and rollback strategies
• Implement monitoring and observability for production models: latency, throughput, data drift detection, and automated alerting with tools like Prometheus, Grafana, and Evidently
• Develop feature stores and data pipeline integrations (Airflow, dbt, Spark) ensuring consistency between training and serving environments
• Optimize training and inference costs across cloud providers (AWS, GCP, or Azure), including GPU utilization, spot instance strategies, and model quantization where appropriate
• Establish MLOps best practices across teams: model registries, experiment tracking, reproducibility standards, and infrastructure-as-code with Terraform
• Partner with ML engineers and data scientists to debug production incidents, profile performance bottlenecks, and improve deployment velocity

What We Are Looking For

• 3-6 years of experience in MLOps, DevOps, or platform engineering, with at least 2 years supporting ML systems in production
• Strong proficiency with Kubernetes, Docker, and cloud infrastructure (AWS, GCP, or Azure) in production environments
• Hands-on experience with ML tooling: MLflow, Kubeflow, SageMaker, Vertex AI, or equivalent model deployment and tracking platforms
• Solid software engineering skills in Python and/or Go, including infrastructure-as-code experience with Terraform or Pulumi
• Experience building observability for distributed systems: metrics, logging, tracing, and drift monitoring for ML workloads
• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
• Bonus: Experience with GPU scheduling (NVIDIA device plugins, Slurm), LLM inference optimization (vLLM, TensorRT), or building internal ML platforms used by multiple teams