Senior ML Platform Engineer: Scale Production Pipelines

Datavant; Montpelier (VT); On-site; USD 224,000 - 280,000; Full time

Job summary

Datavant seeks a Staff ML Platform Engineer to lead the ML Platform team and shape the paved road from notebook to production. You will guide training, serving, and observability, while owning core infrastructure and scalable pipelines for regulated health data.

Ideal candidates combine AI fluency with strong software engineering, cloud and data tooling experience, and a track record of building self-serve platforms for data science teams.

Qualifications

• 10+ years software engineering experience.
• 3+ years designing, evolving, and operating enterprise-scale ML platforms in production.
• Hands-on with Databricks and/or SageMaker, MLflow, and at least one core ML framework (PyTorch or TensorFlow).
• Fluency in Java and Python; strong Spark experience for large-scale data.
• Deep AWS expertise: networking, IAM, GPU compute, storage and messaging services.
• Fluency with Terraform, containers, Kubernetes, and GitHub-based CI/CD for ML workloads.
• Direct experience serving LLMs in production, including cost management and safe handling of prompts.
• AI-native workflow: daily use of Claude Code, Cursor, Copilot or equivalents.

Responsibilities

• Set technical direction across ML training, serving, and observability; be the escalation point for complex infrastructure problems.
• Own and evolve the paved-road framework for model workflows and Databricks assets.
• Lead architecture for LLM-endpoint serving across managed providers and self-hosted deployments.
• Own standards and tooling for MLflow, model registry, and training image supply chain.
• Partner with Data & ML Platform teammates to present a cohesive ML platform to teams.
• Serve as input to vendor/platform selection decisions across model providers and tooling.
• Mentor senior engineers and stay hands-on with high-leverage code and IaC.

Skills

Databricks

SageMaker

MLflow

Java

Python

Spark

Terraform

Kubernetes

CI/CD

LLMs deployment

Tools

Databricks

SageMaker

MLflow

Terraform

Job description

Datavant seeks a Staff ML Platform Engineer to lead the ML Platform team and shape the paved road from notebook to production. You will guide training, serving, and observability, while owning core infrastructure and scalable pipelines for regulated health data.

Ideal candidates combine AI fluency with strong software engineering, cloud and data tooling experience, and a track record of building self-serve platforms for data science teams.