Senior ML Engineer, Data Infrastructure & Pipelines

Unity Technologies SF; Mountain View (CA); On-site; USD 210,000 - 273,000; Full time

Benefits offered by this job

Health insurance

Commuter subsidy

Employee stock ownership

Competitive retirement/pension plans

Generous vacation and personal days

Parental leave programs

Office snacks

Mental Health and Wellbeing programs

Employee Resource Groups

Global Employee Assistance Program

Training and development programs

Volunteering and donation matching

Job summary

Unity Technologies SF is seeking a Senior Machine Learning Engineer, Data Infrastructure, to design and evolve the offline data platform for large-scale model datasets and experiments. You will partner with ML engineers and platform teams to ensure reliability, scalability, and cost efficiency of data pipelines.

The role emphasizes building infrastructure for batch and streaming processing, training data generation, and end-to-end workflow orchestration using tools like Flyte and Airflow.

Qualifications

• Experience with distributed computing frameworks for batch/stream processing.
• Building infrastructure for training data generation or ML feature pipelines.
• Optimizing large-scale data pipelines for cost and performance.
• Strong Python programming and handling large-scale workloads.
• Familiarity with data lakes, warehouses, orchestration systems, and streaming platforms.
• Ability to guide architectural decisions across teams without formal authority.

Responsibilities

• Develop infrastructure supporting batch and streaming data processing.
• Design pipelines to generate training datasets for ML training and experimentation.
• Integrate pipelines with workflow orchestration systems for multi-stage training workflows.
• Improve reproducibility and observability with validation, monitoring, and tests.
• Optimize resource usage across distributed compute environments.
• Collaborate with ML engineers to enable large-scale experimentation and model iteration.
• Lead architectural improvements for scalable, reliable offline data pipelines.

Skills

Python

Distributed computing

Data pipelines

ML data generation

Tools

Flink

Spark

Ray

Flyte

Airflow

Job description

Unity Technologies SF is seeking a Senior Machine Learning Engineer, Data Infrastructure, to design and evolve the offline data platform for large-scale model datasets and experiments. You will partner with ML engineers and platform teams to ensure reliability, scalability, and cost efficiency of data pipelines.

The role emphasizes building infrastructure for batch and streaming processing, training data generation, and end-to-end workflow orchestration using tools like Flyte and Airflow.