Senior ML Performance Engineer: GPU Training & Inference

NVIDIA Corporation; United States; On-site; USD 224,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation is seeking a Software Engineer, ML Performance to join the team in Santa Clara, CA. You will work directly with the latest AI tech, optimizing performance at scale and ensuring our groundbreaking solutions run flawlessly.

The role emphasizes rigorous analysis, strong programming in Python and CUDA, and clear communication with workload owners. As an NVIDIAN, you will influence performance across distributed training and inference workloads, collaborate with build partners, and

Qualifications

• Bachelor's degree in CS/CE or related field or equivalent experience.
• 12+ years of software engineering experience, including hands-on optimization of GPU training or inference workloads in production.
• Demonstrated performance work across multiple stack layers with baseline and validated outcomes.
• Experience diagnosing performance across many jobs, machines or tenants, not just a single workload.
• Familiarity with framework, runtime and compiler interfaces to indicate where signals should be measured.
• Ability to distinguish symptoms from causes and interpret measurements correctly.
• Strong programming and debugging skills with maintainable analysis code and tests.
• Clear communication of findings, trade-offs and remaining uncertainty to workload owners.
• Proficiency with Python and CUDA.

Responsibilities

• Analyze performance of distributed training and inference across the stack; identify bottlenecks and propose solutions with evidence.
• Define performance metrics for a GPU fleet and guide what signals are collected first.
• Drive regression analysis across workloads, versions, and configurations to isolate causes.
• Evaluate automated diagnoses; judge accuracy and build labeled cases for robust analysis.
• Collaborate with build partners on real workloads and feed findings into the product roadmap.

Skills

Python

CUDA

Performance optimization

Education

Bachelor's degree in Computer Science, Computer Engineering, or related field

Tools

NCCL

TensorRT-LLM

Megatron

PyTorch

Job description

NVIDIA Corporation is seeking a Software Engineer, ML Performance to join the team in Santa Clara, CA. You will work directly with the latest AI tech, optimizing performance at scale and ensuring our groundbreaking solutions run flawlessly.

The role emphasizes rigorous analysis, strong programming in Python and CUDA, and clear communication with workload owners. As an NVIDIAN, you will influence performance across distributed training and inference workloads, collaborate with build partners, and