ML Performance Engineer — Scale Distributed Training & Throughput

applied; Sunnyvale (CA); On-site; USD 170,000 - 230,000; Full time

Job summary

Applied Intuition, Inc. is seeking a performance engineer to accelerate large-scale ML workloads in the data center. You will own profiling, optimization, and cost-efficiency for distributed training and large offline inferences.

You will work across accelerators, ML frameworks, and data infra, partnering with teams to land improvements that shorten time-to-result and reduce data processing costs. Collaboration and technical excellence are valued.

Qualifications

• Hands-on ML performance engineering experience: profiling, roofline analysis, throughput optimization, and root-cause investigation in production systems.
• Experience with distributed multi-node training at scale (FSDP, DeepSpeed, Megatron, NCCL, or equivalent).
• Deep familiarity with GPU/accelerator performance concepts: memory bandwidth, kernel launch overhead, occupancy, quantization, collective communication.
• Experience with high-throughput or batch inference systems: Triton/TensorRT/ONNX etc.

Responsibilities

• Profile and optimize distributed training end-to-end: data loading, preprocessing, augmentation, kernel execution, gradient communication, checkpointing.
• Optimize large-scale offline and batch inference over petabyte-scale logs: batching, scheduling, quantization, graph optimization, accelerator saturation.
• Establish roofline and performance models, quantify gaps between achieved and theoretical performance, rank opportunities by impact.
• Collaborate across teams to improve multi-node scaling, memory bandwidth, and scheduling gaps on long-running jobs.
• Build benchmarking, observability, and regression-detection tooling to prevent performance degradation as models evolve.

Skills

ML performance engineering

Distributed training

GPU performance

Python

C++

Debugging

Education

Bachelor's degree in CS/Math/related

Tools

NVIDIA Triton

TensorRT

ONNX Runtime

DeepSpeed

Job description

Applied Intuition, Inc. is seeking a performance engineer to accelerate large-scale ML workloads in the data center. You will own profiling, optimization, and cost-efficiency for distributed training and large offline inferences.

You will work across accelerators, ML frameworks, and data infra, partnering with teams to land improvements that shorten time-to-result and reduce data processing costs. Collaboration and technical excellence are valued.