Senior ML Platform Engineer - Online Inference

Unity; Walla Walla (WA); On-site; USD 187,000 - 243,000; Full time

Benefits offered by this job

Health insurance

Commuter subsidy

Employee stock ownership

Retirement plan

Vacation & leave

Parental leave

Office snacks

Mental health programs

Employee Resource Groups

Training & development

Volunteering & donation matching

Job summary

Unity Vector seeks a Senior ML Engineer to design and evolve its online model inference platform, building reliable infrastructure for serving ML models in production and optimizing inference performance.

You will collaborate with ML engineers, platform teams and product stakeholders to deploy, scale, monitor, and iterate models, shaping packaging, validation, and deployment workflows.

Qualifications

• Experience building and operating production-grade online ML inference systems.
• Experience with model serving frameworks such as Triton, TorchServe, Ray Serve or TensorFlow Serving.
• Experience optimizing inference workloads (dynamic batching, quantization, GPU acceleration, runtime tuning).
• Strong distributed systems experience with Kubernetes, autoscaling and observability.
• Strong Python programming with production ML systems experience.
• Experience with model packaging, validation and serving lifecycle management.
• Ability to lead architectural decisions across teams without formal authority.

Responsibilities

• Design and operate large-scale online inference infrastructure with low latency and high reliability.
• Develop infrastructure for distributed training workflows.
• Integrate ML pipelines with workflow orchestration for reliable multi-stage training.
• Optimize model performance through compilation, GPU/utilization improvements and tuning.
• Improve observability of ML systems (latency, throughput, error-rate, cost).
• Collaborate with ML engineers to support fast model iteration while ensuring safety and cost efficiency.
• Lead deployment workflows, packaging, validation, and automated rollout canaries.

Skills

ML infrastructure

Python programming

Kubernetes

PyTorch

Model deployment

System design

Production systems

Canary testing

Tools

Triton Inference Server

TorchServe

Ray Serve

TensorFlow Serving

Job description

Unity Vector seeks a Senior ML Engineer to design and evolve its online model inference platform, building reliable infrastructure for serving ML models in production and optimizing inference performance.

You will collaborate with ML engineers, platform teams and product stakeholders to deploy, scale, monitor, and iterate models, shaping packaging, validation, and deployment workflows.