Staff Machine Learning Engineer

Unity; California (MO); On-site; USD 180,000 - 240,000; Full time

Job summary

Unity seeks a Senior ML Engineer for On-Device & Mobile AI to optimize, deploy, and maintain high-performance inference stacks across mobile, desktop, and embedded hardware. You will push efficient multi-modal models—transformers, diffusion, and VLMs—into shipping features with tight latency and memory budgets.

You will work across WebGPU-based runtimes and native options, tuning kernels, and implementing quantization and pruning to meet power and speed targets on diverse SKUs, while

Qualifications

• 5+ years in software/ML engineering with on-device or real-time systems.
• Production deployment of transformer- and/or diffusion-based models on mobile/embedded hardware.
• Hands-on experience with major inference runtimes (ORT Web, CoreML, TFLite, ExecuTorch).
• Low-level performance engineering with GPU/compute APIs and profiling tools.

Responsibilities

• Own the optimization and deployment pipeline for on-device models: export, graph transformation, operator fusion, memory planning, hardware tuning.
• Implement quantization (INT4/INT8/FP16), weight sharing, pruning, and distillation to meet latency and memory budgets.
• Write and tune WebGPU compute shaders and native kernels; profile with browser/platform tools and fix bottlenecks.
• Collaborate with ML researchers to productionize CV and multi-modal architectures for on-device usage.

Skills

On-device inference

Model optimization

WebGPU/WGSL/Metal/Vulkan/CUDA

Profiling & debugging

Python for export pipelines

TypeScript/JavaScript familiarity

Transformer/diffusion deployment

Runtime scheduling

Tools

ONNX Runtime Web

CoreML

TFLite

ExecuTorch

WebGPU

WGSL

Metal

Vulkan

CUDA

Job description

The opportunity

We are building the next generation of AI-driven game experiences, running generative models on-device, right where the players are — on phones, tablets, laptops, and desktops. Our games run inside a modern, browser-native runtime (built on technologies such as WebGPU and WebNN), so the models that power these experiences must be deployed and accelerated entirely within that runtime. As a Senior Machine Learning Engineer for On-Device & Mobile AI, you will take state-of-the-art multi-modal models — transformers, diffusion networks, and vision-language models (VLMs) — and make them run fast, small, and reliably on mobile and constrained hardware.

This is a deeply hands‑on role. You will own the optimization and deployment of significant parts of the inference stack — from a trained checkpoint leaving research, through export, quantization, and kernel‑level tuning, to a shipped feature running inside the engine at interactive frame rates within a fixed memory and power budget. Your work directly shapes the latency, quality, memory footprint, and battery profile of AI features experienced by billions of players.

This role is for an engineer who is energized by the gap between a research model and a shipping, on‑device product. If you enjoy profilers, frame captures, op‑fusion, and shaving milliseconds and megabytes, this is your role.

What You’ll Be Doing

• Inference & On-Device Optimization
• Own the optimization pipeline for the models you ship: model export, graph transformation, operator fusion, memory‑layout planning, and hardware‑specific tuning across NPU, mobile GPU, and desktop/laptop GPU.
• Apply quantization (INT4/INT8/FP16), weight sharing, structured/unstructured pruning, and knowledge distillation to hit hard latency, memory, and power budgets — and validate them against quality bars.
• Do low‑level performance work: write and tune WebGPU compute shaders (WGSL) and, where relevant, native kernels (Metal, Vulkan/SPIR‑V compute, CUDA); profile with browser and platform tools (Chrome/Dawn GPU traces, PIX, Instruments/Metal System Trace,
• Snapdragon Profiler, Nsight, RenderDoc), and eliminate bottlenecks at the op and memory‑bandwidth level.
• Apply efficiency techniques — dynamic resolution, token reduction, cross‑frame caching/reuse, reduced‑step diffusion samplers — as engineering levers to meet budgets on target SKUs.
• Runtime & Systems Integration
• Work with WebGPU‑targeted inference runtimes (ONNX Runtime Web, Transformers.js, WebLLM, TensorFlow.js) alongside native options (CoreML, ONNX Runtime, TFLite, ExecuTorch), and extend or build glue code where off‑the‑shelf options fall short of our diffusion and VLM workloads.
• Build parts of the integration between the ML runtime and the game engine: real‑time scheduling, memory pooling, zero‑copy buffer sharing between the inference and render paths, and frame‑budget management alongside the renderer.
• Build supporting engineering for your components: model packaging and asset pipelines, on‑device fallbacks and SKU‑aware capability tiers, crash/quality telemetry, and automated on‑device benchmarking in CI.
• Research Productionization
• Partner with research scientists to turn novel CV and multi‑modal architectures into implementations that are deployable, debuggable, and fast on device.
• Provide a feedback loop into research: surface hardware constraints, op‑support gaps, and cost models early so model design and deployment converge.
• Track breakthroughs in efficient inference (efficient attention, distillation, reduced‑step diffusion) and assess them pragmatically: what actually moves latency/memory/power on our target devices.
• Collaboration & Engineering Quality
• Contribute to engineering best practices, code‑review standards, performance‑regression gates, and on‑device benchmarking methodology.
• Support a culture of measurement: track KPIs for latency, quality, memory, and power for the systems you work on, across the device matrix.
• Partner with platform engineers, product managers, and runtime teams to align your work with device‑SKU constraints and product roadmaps.
• Share knowledge and mentor junior and mid‑level engineers through code review, pairing, and design discussion.

What We’re Looking For

• 5+ years in software/ML engineering, with meaningful time focused on on‑device / edge inference or real‑time, performance‑critical systems.
• Production deployment of transformer‑and/or diffusion‑based models (e.g., ViT, Stable Diffusion, CLIP/SigLIP‑style encoders) on mobile, desktop, or embedded hardware — shipped, not just prototyped.
• Hands‑on experience with at least one major inference runtime (ONNX Runtime / ORT Web, CoreML, TFLite, ExecuTorch) and a working understanding of operator fusion, memory layout, and runtime scheduling.
• Low‑level performance engineering: solid command of at least one GPU/compute API — WebGPU/WGSL, Metal, Vulkan, D3D12, or CUDA — and the profiling tools to go with it. You can read a frame capture and a kernel trace and reason about where the time and memory go.
• Working knowledge of model‑optimization techniques — quantization (INT4/INT8/FP16), weight sharing, pruning, and distillation — and the judgment to apply them to hit latency and memory budgets. You use them effectively as engineering tools.
• Understanding of target hardware: mobile SoCs (Apple Neural Engine, Qualcomm Hexagon/Adreno, ARM Mali) and/or desktop/laptop GPUs (Apple Silicon, NVIDIA, AMD, Intel).
• Strong Python for export pipelines and training‑side tooling; familiarity with the core languages of a browser‑native runtime (TypeScript/JavaScript, WGSL) is a plus.
• Working fluency with the models you deploy — enough to read an architecture, modify it for deployment, and reason about accuracy trade‑offs.
• A collaborative working style: clear communication, reliable delivery, and a willingness to support and learn from teammates.

You might also have

• Experience shipping world‑model, neural‑rendering, or real‑time generative pipelines NeRF, 3DGS, real‑time diffusion, or similar) on device.
• Hands‑on experience deploying models through WebGPU — e.g., ONNX Runtime Web WebGPU EP), Transformers.js, WebLLM, or TensorFlow.js — including writing/tuning WG