Senior ML Platform Engineer AI Infra & Self-Serve Pipelines

Datavant; Nashville (TN); Remote; USD 224,000 - 280,000; Full time

Job summary

Datavant is seeking a Staff ML Platform Engineer to lead the ML Platform team, owning the paved road from notebook to production and driving architecture for training, serving, and observability. You will ensure data safety and operational guardrails while enabling data science teams to self-serve.

You will mentor engineers, influence platform standards, and contribute hands-on work across cloud providers (Databricks, AWS), IaC, and evolving ML tooling.

Qualifications

• 10+ years of software engineering experience with 3+ years designing, evolving, and operating enterprise-scale ML platforms in production.
• Hands-on production experience with Databricks and/or Amazon SageMaker and MLflow or equivalent tracking/registry system.
• Fluency in Java and Python with strong Apache Spark experience for large-scale data and distributed compute.

Responsibilities

• Set technical direction across ML training, serving, and observability, acting as final escalation point for performance and reliability issues.
• Own and evolve the paved-road framework so Data Science teams can go from a config file to production workflows without bespoke plumbing.
• Lead architecture for LLM-endpoint serving across managed providers and self-hosted deployments, addressing latency, cost, caching, evaluation, and PHI-safe routing.
• Own the standards for MLflow, model registry, training image supply chain, and observability across training and inference.
• Partner with Data & ML Platform teammates to present a cohesive ML platform to Data Science, App Dev, and Operations teams at Datavant.
• Serve as a technical input to vendor and platform selection decisions for model providers, ML tooling, and observability.
• Mentor senior engineers, provide guidance to platform consumers, and contribute hands-on IaC alongside teammates.

Skills

Software engineering

ML platform design

Java / Python

Databricks / SageMaker

Terraform / Kubernetes

LLM serving / safety

Async communication

Tools

Databricks

SageMaker

MLflow

Terraform

Kubernetes

CI/CD tooling

Job description

Datavant is seeking a Staff ML Platform Engineer to lead the ML Platform team, owning the paved road from notebook to production and driving architecture for training, serving, and observability. You will ensure data safety and operational guardrails while enabling data science teams to self-serve.

You will mentor engineers, influence platform standards, and contribute hands-on work across cloud providers (Databricks, AWS), IaC, and evolving ML tooling.