Senior ML Data Platform Engineer: Databricks & AWS

National Geographic; Greater London; On-site; GBP 70,000 - 110,000; Full time

Job summary

DraftKings is building the backbone of its ML capabilities. As a Senior Data Platform Engineer, you will design, scale, and operate the Databricks and cloud infrastructure powering reproducible ML workflows across our business.

You will collaborate with Data Science, ML Engineering, and Infra teams, own Databricks infra, implement IaC with Terraform or Pulumi, and push for usability, efficiency, and scalability while documenting initiatives.

Qualifications

• 3+ years in ML platform, data platform, infrastructure, or data engineering roles.
• Hands-on experience with Databricks in production.
• Strong IaC knowledge, especially Terraform or Pulumi.
• Proficiency with AWS and container tech (Docker, Kubernetes).
• Solid Python skills and ML libraries (MLflow, pandas, scikit-learn).
• Track record of owning and operating complex systems at scale.
• Strong communication and cross-functional collaboration.

Responsibilities

• Own and operate Databricks infrastructure for performance, reliability, cost-efficiency.
• Build and manage cloud infrastructure using AWS and IaC tools like Terraform or Pulumi.
• Collaborate with Data Scientists, Data Engineers, ML Engineers, and Infra to align platform features.
• Lead complex engineering projects from design through implementation and long-term support.
• Continuously assess and improve platform usability, efficiency, and scalability with best practices.
• Champion technical excellence through peer reviews, mentorship, and deep documentation.

Skills

ML Platform

Data Platform

Infrastructure

Data Engineering

Tools

Databricks

Terraform

Pulumi

AWS

Docker

Kubernetes

Python

MLflow

Pandas

Scikit-learn

Job description

DraftKings is building the backbone of its ML capabilities. As a Senior Data Platform Engineer, you will design, scale, and operate the Databricks and cloud infrastructure powering reproducible ML workflows across our business.

You will collaborate with Data Science, ML Engineering, and Infra teams, own Databricks infra, implement IaC with Terraform or Pulumi, and push for usability, efficiency, and scalability while documenting initiatives.