Staff ML Platform Engineer: Scale Production ML

Datavant; Boise (ID); On-site; USD 224,000 - 280,000; Full time

Job summary

Datavant is hiring a Staff ML Platform Engineer to lead the Data & ML Platform team. You will drive the paved road for ML training, serving, and observability, enabling Data Science teams to self-serve from config to production.

Responsibilities include architecture for LLM-endpoint serving, managing the CI/CD spine, and ensuring PHI-safe routing. You will mentor engineers and work hands-on with IaC and core ML tooling in a remote-friendly, high-performance culture.

Qualifications

• 10+ years of software engineering experience, with 3+ years designing, evolving, and operating enterprise-scale ML platforms in production.
• Strong technical judgment under ambiguity and a track record of setting standards, influencing peers, and raising the bar across teams.
• Hands-on production experience with Databricks and/or Amazon SageMaker, MLflow (or equivalent tracking/registry), and at least one core ML framework (PyTorch, TensorFlow).
• Fluency in Java (or JVM) and Python, with depth in Apache Spark for large-scale data and distributed compute.
• Real depth in AWS: networking, IAM, GPU compute, storage, and messaging services.
• Fluency with Terraform, containers, Kubernetes, and GitHub-based CI/CD for ML workloads.
• Direct experience serving LLMs in production, including cost management, evaluation harnesses, and safe handling of prompts/outputs.
• AI-native working style: daily use of Claude Code, Cursor, Copilot, or equivalent.
• Clear written and verbal communication, especially in async, remote settings.

Responsibilities

• Set technical direction across ML training, serving, and observability, and be the final escalation point for the most elusive infrastructure problems (GPU capacity, Spark tuning, production incidents).
• Own and evolve our paved-road framework (shared CI/CD spine, model-workflow scaffolding, Databricks Asset Bundles) to production workflows from config files.
• Lead architecture for LLM-endpoint serving across managed and self-hosted deployments, covering latency, cost, caching, evaluation, and PHI-safe routing.
• Own standards and tooling for MLflow, model registry, training image supply chain, and observability across training and inference.
• Partner with Data & ML Platform teammates to present a cohesive ML platform to Data Science, App Dev, and Operations teams at Datavant.
• Serve as a key technical input to vendor and platform selection decisions across model providers, ML tooling, and observability.
• Mentor senior engineers, provide technical guidance to platform consumers, and stay hands-on with IaC and high-leverage code.

Skills

Java

Python

Apache Spark

AWS

Databricks

SageMaker

Terraform

Kubernetes

CI/CD

LLM Serving

Tools

Databricks

SageMaker

MLflow

Iceberg

Delta Lake

Job description

Datavant is hiring a Staff ML Platform Engineer to lead the Data & ML Platform team. You will drive the paved road for ML training, serving, and observability, enabling Data Science teams to self-serve from config to production.

Responsibilities include architecture for LLM-endpoint serving, managing the CI/CD spine, and ensuring PHI-safe routing. You will mentor engineers and work hands-on with IaC and core ML tooling in a remote-friendly, high-performance culture.