Senior ML Data Platform Engineer (Hybrid Bay Area)

Liftoff; San Francisco (CA); Hybrid; USD 180,000 - 230,000; Full time

Job summary

Liftoff is seeking a Software Engineer on the Machine Learning Data Platform team to design and build scalable ML infrastructure, data lake tooling, and model training pipelines. You will work with ML, software, and infrastructure engineers to enable next-generation ML models and technologies.

The role requires strong Python and Golang coding skills, 6+ years of experience, and familiarity with Spark and big data tooling.

Qualifications

• Very strong coding ability in Python and Golang.
• Strong core CS fundamentals (data structures, algorithms, architecting systems).
• 6+ years of industry experience.
• Experience with Spark is a plus.
• Experience building ML tooling or platforms for large-scale problems is a big plus.

Responsibilities

• Design, engineer & implement reliable, scalable, and cost-efficient systems to support data lake infrastructure, dataset generation, model training infrastructure, analytics, reporting and monitoring infrastructure.
• Deliver business results by enabling next generation ML models and technologies.
• Collaborate with ML, Software, and Infrastructure Engineers to build the ML platform for Liftoff.

Skills

Python

Golang

Algorithms

Data structures

System design

Tools

PyTorch

PySpark

Trino

Hive

Iceberg

ClickHouse

AWS

Weights & Biases

Job description

Liftoff is seeking a Software Engineer on the Machine Learning Data Platform team to design and build scalable ML infrastructure, data lake tooling, and model training pipelines. You will work with ML, software, and infrastructure engineers to enable next-generation ML models and technologies.

The role requires strong Python and Golang coding skills, 6+ years of experience, and familiarity with Spark and big data tooling.