Staff ML Platform Engineer: Enterprise-Scale ML Pipelines

Datavant; Jackson (MS); On-site; USD 224,000 - 280,000; Full time

Job summary

Datavant is seeking a Staff ML Platform Engineer to lead the ML Platform team, owning the paved road from training to production. You will drive architecture for LLM-endpoint serving across Databricks, AWS, and self-hosted deployments, while ensuring safe handling of PHI and regulated data.

Ideal candidates have 10+ years in software, 3+ in enterprise ML platforms, and hands-on experience with Databricks, SageMaker, MLflow, and Spark.

Qualifications

• 10+ years of software engineering experience with 3+ years designing enterprise-scale ML platforms
• Strong judgment under ambiguity with track record of raising the bar across teams
• Hands-on production experience with Databricks and/or SageMaker, MLflow, and core ML frameworks (PyTorch, TensorFlow)
• Fluency in Java and Python, with deep Spark experience for large-scale data
• AWS expertise including networking, IAM, GPU compute, storage and messaging services
• Terraform, containers, Kubernetes, and GitHub-based CI/CD for ML workloads
• Experience serving LLMs in production, including cost management and safe handling of prompts
• AI-native workflow using Claude Code, Cursor, Copilot, etc.
• Clear written and verbal communication for async, remote settings

Responsibilities

• Set technical direction across ML training, serving, and observability; escalation point for infrastructure issues
• Evolve our paved-road framework for Data Science to production workflows
• Lead architecture for LLM-endpoint serving across providers and self-hosted deployments
• Own standards and tooling for MLflow, model registry, training image supply chain, and observability
• Partner with Data & ML Platform teammates to present a cohesive ML platform to teams
• Provide input on vendor and platform selections for model providers and tooling
• Mentor senior engineers and contribute hands-on code and IaC

Skills

Java

Python

Spark

AWS

Team leadership

Mentoring

AI fluency

async communication

Education

Bachelor's degree in Computer Science or related

Tools

Databricks

SageMaker

MLflow

Terraform

Kubernetes

GitHub CI/CD

Databricks Asset Bundles

Unity Catalog

Iceberg

Delta

Kafka

Kinesis

Job description

Datavant is seeking a Staff ML Platform Engineer to lead the ML Platform team, owning the paved road from training to production. You will drive architecture for LLM-endpoint serving across Databricks, AWS, and self-hosted deployments, while ensuring safe handling of PHI and regulated data.

Ideal candidates have 10+ years in software, 3+ in enterprise ML platforms, and hands-on experience with Databricks, SageMaker, MLflow, and Spark.