Senior ML Performance Engineer: Scale & Throughput

NLP PEOPLE; Sunnyvale (CA); On-site; USD 215,000 - 285,000; Full time

Job summary

Applied Intuition, Inc. in Sunnyvale, CA, is seeking a performance engineer to optimize large-scale ML workloads in the datacenter.

This role focuses on distributed training across many nodes and high-throughput batch inference over petabytes of real-world autonomy logs for data mining and evaluation. You will own the gap between theoretical capability of accelerators and actual workload performance, performing profiling across the stack and closing the difference to improve training

Qualifications

• Hands-on ML performance engineering experience with profiling and roofline analysis.
• Experience with distributed multi-node training at scale and diagnosing scaling inefficiency.
• Deep familiarity with GPU/accelerator performance concepts and memory bandwidth.
• Experience with high-throughput or batch inference systems such as Triton or TensorRT.
• Fluency in Python; proficiency in C++ or another systems language.
• Strong debugging, analytical, and problem-solving skills.

Responsibilities

• Profile and optimize distributed training end-to-end across data loading, preprocessing, and communication.
• Optimize large-scale offline and batch inference over petabyte-scale sensor logs.
• Establish roofline and performance models; rank optimization opportunities by impact and effort.
• Improve multi-node scaling efficiency and manage interconnect utilization.
• Drive cluster goodput by reducing GPU idle time in pipelines and checkpoints.
• Build benchmarking, observability, and regression-detection tooling.
• Collaborate with engineers across functions to solve data and compute problems at scale.

Skills

Performance engineering

Distributed training

Python

C++

GPU/accelerator concepts

Profiling tools

Multi-node scaling

Problem solving

ML fundamentals

Tools

NVIDIA Triton

TensorRT

ONNX Runtime

Ray

NCCL

Kubernetes

Nsight Systems/Compute

PyTorch

Job description

Applied Intuition, Inc. in Sunnyvale, CA, is seeking a performance engineer to optimize large-scale ML workloads in the datacenter.

This role focuses on distributed training across many nodes and high-throughput batch inference over petabytes of real-world autonomy logs for data mining and evaluation. You will own the gap between theoretical capability of accelerators and actual workload performance, performing profiling across the stack and closing the difference to improve training