Senior ML Engineer, LLMOps & Production Systems

Tech Economy; Houston (TX); Hybrid; USD 148,000 - 162,000; Full time

Job summary

Bain & Company in Texas is seeking a Senior ML Engineer to own the lifecycle of production ML models, prompts, and retrieval pipelines. You will partner with Data Scientists and Data Engineers to deliver robust AI capabilities that scale across engagements.

The role emphasizes hands-on development, observability, and production-grade standards in a hybrid in-office setting at least one day per week.

Qualifications

• Bachelor’s degree or equivalent practical experience in CS/ML.
• 6+ years building and operating production ML systems.
• Experience owning model and prompt lifecycle end-to-end.
• Experience building RAG/retrieval systems end-to-end.
• Collaborates with data science, data engineering, and product teams.

Responsibilities

• Deploy, operate, and optimize production ML serving systems.
• Own model/prompt lifecycle, registries, and rollout strategies.
• Build and maintain LLMOps tooling for prompts, gateways, and caching.
• Develop end-to-end RAG/retrieval pipelines and evaluation frameworks.
• Mentor engineers and enforce production coding standards.

Skills

Python

MLflow

LLMOps

Databricks

AWS

Docker

Kubernetes

LangChain

Education

Bachelor’s degree in Computer Science or related field

Tools

Portkey

Model registry

Vector stores

Job description

Bain & Company in Texas is seeking a Senior ML Engineer to own the lifecycle of production ML models, prompts, and retrieval pipelines. You will partner with Data Scientists and Data Engineers to deliver robust AI capabilities that scale across engagements.

The role emphasizes hands-on development, observability, and production-grade standards in a hybrid in-office setting at least one day per week.