Real-Time Embedded ML Engineer for AR/VR

SGS Consulting; Redmond; On-site; AUD 215,000 - 272,000; Full time

Job summary

Reality Labs Research is seeking a ML Software Engineer to bring state‑of‑the‑art machine learning from the lab to embedded hardware. You will train and adapt models, optimize and port them to constrained devices, and profile on-device performance, collaborating with researchers to achieve real-time AR/VR outcomes.

The role requires hands-on experience with PyTorch or TensorFlow, strong C/C++ skills, and a track record of optimizing ML workloads for embedded targets.

Qualifications

• Industry experience optimizing and running ML inference on embedded or resource-constrained devices.
• Experience training ML models using deep learning frameworks such as PyTorch or TensorFlow.
• 2+ years of industry experience writing C/C++.
• Experience profiling and debugging performance issues across the ML model and the target hardware.
• Experience working in cross-functional teams.

Responsibilities

• Work side by side with research scientists to take ML models from research prototypes to efficient, real-time inference on embedded devices.
• Train, fine-tune, and adapt ML models with deployment constraints (latency, memory, power, compute) in mind.
• Optimize models for on-device inference using techniques such as quantization, pruning, distillation, operator fusion, and architecture adjustments.
• Port, integrate, and profile ML models on embedded targets (e.g. DSPs, NPUs, microcontrollers, mobile SoCs), identifying and resolving performance bottlenecks.
• Write clean, maintainable, high-performance C/C++ code for on-device inference pipelines and integrate it into real-time prototype systems.
• Build tools and infrastructure that make it faster for researchers to evaluate model performance and accuracy on target hardware.
• Coordinate with internal hardware, runtime, and toolchain teams across RL to evaluate and integrate with existing systems.
• Work collaboratively as part of a multifunctional team where communication, documentation, and teamwork are highly valued.
• Learn constantly, dive into new areas with unfamiliar technologies, and embrace the ambiguity of AR/VR problem solving.

Skills

On-device ML optimization

PyTorch/TensorFlow

C/C++

Embedded systems

Profiling & debugging

Tools

ExecuTorch

TFLite/LiteRT

ONNX Runtime

Job description

Reality Labs Research is seeking a ML Software Engineer to bring state‑of‑the‑art machine learning from the lab to embedded hardware. You will train and adapt models, optimize and port them to constrained devices, and profile on-device performance, collaborating with researchers to achieve real-time AR/VR outcomes.

The role requires hands-on experience with PyTorch or TensorFlow, strong C/C++ skills, and a track record of optimizing ML workloads for embedded targets.