Senior ML Infrastructure Engineer - Scalable Data Pipelines

Unity; Bellevue (WA); On-site; USD 165,000 - 273,000; Full time

Job summary

Unity is seeking a senior data infra engineer to design and evolve our large-scale offline data platform. You will own and improve pipelines for generating training datasets and orchestrating training workloads, partnering with ML engineers and platform teams to scale with data growth.

You will drive architectural improvements for reliable, scalable, and cost-efficient offline data infrastructure, enabling efficient model training and experimentation across the org.

Qualifications

• Experience with distributed computing frameworks (e.g., Flink, Spark, Ray).
• Experience building infrastructure for training data generation or ML feature pipelines.
• Experience optimizing big data pipelines and infrastructure for cost efficiency.
• Strong Python programming skills and experience with large-scale distributed workloads.
• Familiarity with modern data infrastructure (data lakes, warehouses, orchestration systems, streaming platforms).
• Strong systems thinking and ability to balance performance, scalability, reliability, and cost in distributed systems.
• Proven ability to lead technical direction across teams without formal authority.

Responsibilities

• Develop infrastructure supporting batch and streaming big data processing.
• Design and operate large-scale data pipelines for training datasets and ML workflows.
• Integrate data pipelines with workflow orchestration systems for reliable multi-stage training.
• Improve reproducibility and observability of data pipelines through dataset validation and monitoring.
• Optimize performance and resource utilization across distributed compute systems.
• Partner with ML engineers to enable large-scale experimentation and model iteration.
• Lead architectural improvements to keep offline data pipelines scalable, reliable, and cost-efficient.

Skills

Distributed frameworks

Python programming

Data pipelines

Leadership without authority

Cost optimization

ML data infra

Tools

Flyte

Airflow

Job description

Unity is seeking a senior data infra engineer to design and evolve our large-scale offline data platform. You will own and improve pipelines for generating training datasets and orchestrating training workloads, partnering with ML engineers and platform teams to scale with data growth.

You will drive architectural improvements for reliable, scalable, and cost-efficient offline data infrastructure, enabling efficient model training and experimentation across the org.