Senior ML Infra Engineer — Real-Time Inference

Unity Technologies SF; Olympia (WA); On-site; USD 166,000 - 273,000; Full time

Benefits offered by this job

Comprehensive health insurance

Commute subsidy

Employee stock ownership

Generous vacation and personal days

Mental Health programs

Volunteering and donation matching

Job summary

Unity Technologies SF is seeking a Senior Machine Learning Engineer to design and evolve Unity Vector’s online inference platform. The role focuses on production infrastructure for low-latency inference, with emphasis on optimization, observability, and safe experimentation.

You will design and operate large-scale online inference infrastructure, build distributed training support, and drive end-to-end serving lifecycle management.

Qualifications

• Experience building production-grade online ML inference systems.
• Experience with model serving frameworks and distributed serving platforms.
• Strong background in distributed systems and production observability.
• Proficiency in Python for high-scale services.
• Experience with PyTorch and modern deployment workflows.

Responsibilities

• Design and operate large-scale online inference infrastructure for production ML models.
• Build infrastructure for distributed training workflows.
• Integrate ML pipelines with workflow orchestration systems.
• Optimize model performance and resource utilization.
• Enhance ML system observability and reliability.
• Collaborate to accelerate model iteration while maintaining safety.
• Improve deployment automation and reproducibility of serving workflows.
• Lead architectural improvements for robustness and cost efficiency.

Skills

Python programming

Distributed systems

Kubernetes

ML inference

Low-latency optimization

Observability

Canary / A/B testing

Canary testing

Production ML systems

Tools

PyTorch

NVIDIA Triton Inference Server

TorchServe

Ray Serve

TensorFlow Serving

Kubernetes

GKE

Ray

Flyte

Airflow

Ray Data

Ray Train

Python

Job description

Unity Technologies SF is seeking a Senior Machine Learning Engineer to design and evolve Unity Vector’s online inference platform. The role focuses on production infrastructure for low-latency inference, with emphasis on optimization, observability, and safe experimentation.

You will design and operate large-scale online inference infrastructure, build distributed training support, and drive end-to-end serving lifecycle management.