Senior ML Systems Engineer – Production & LLMOps

Bain & Company; Chicago (IL); Hybrid; USD 155,000 - 169,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision plan

Generous paid time off

401(k)

Job summary

Bain & Company is seeking a Senior ML Engineer to design, deploy, and operate production ML systems, including models, embeddings, and retrieval pipelines. You will own the model lifecycle, implement LLMOps tooling, and collaborate with cross-functional teams to productionize data-driven solutions.

The role emphasizes building scalable ML infrastructure, establishing governance, and mentoring engineers. A hybrid in-office model is required, with strong focus on performance, cost, and reliability.

Qualifications

• Bachelor’s degree in Computer Science or related field or equivalent practical experience.
• 6+ years of experience building and operating production ML systems, including model deployment, serving, and post-deployment monitoring.
• Experience owning the model and prompt lifecycle end-to-end (packaging, registry, promotion, rollout, monitoring, and rollback).
• Experience building production RAG or retrieval systems end-to-end, including embedding and retrieval through evaluation.

Responsibilities

• Build, deploy, and operate production inference and serving systems for models, embeddings, and re-rankers with latency and cost SLAs.
• Own the model and prompt lifecycle in MLflow and manage rollout behind feature flags.
• Develop LLMOps tooling for prompt/versioning, model gateway config, and caching.
• Create and maintain end-to-end RAG and retrieval pipelines with contextual embedding and hybrid retrieval.
• Design evaluation frameworks and monitoring for models and retrieval with dashboards and alerts.
• Collaborate with data engineers and agent squads to integrate outputs into workflows.
• Lead production ML incident response and enforce production readiness practices.
• Mentor engineers and promote high standards for production ML systems.

Skills

Python

MLflow

LLMOps

Docker

Kubernetes

Databricks

AWS

Education

Bachelor’s degree in Computer Science or related field

Tools

LangChain

LlamaIndex

Portkey

Terraform

Job description

Bain & Company is seeking a Senior ML Engineer to design, deploy, and operate production ML systems, including models, embeddings, and retrieval pipelines. You will own the model lifecycle, implement LLMOps tooling, and collaborate with cross-functional teams to productionize data-driven solutions.

The role emphasizes building scalable ML infrastructure, establishing governance, and mentoring engineers. A hybrid in-office model is required, with strong focus on performance, cost, and reliability.