Senior AI Performance & Efficiency Engineer - Equity Eligible

NVIDIA; California (MO); On-site; USD 152,000 - 288,000; Full time

Benefits offered by this job

Equity

Competitive benefits

Job summary

NVIDIA is seeking a Senior AI/ML Performance and Efficiency Engineer for GPU Clusters to advance AI efficiency across researchers. You will collaborate with researchers to pinpoint infrastructure gaps, build tools, and deliver scalable solutions enhancing AI/ML workloads on GPU clusters.

The role requires strong ML technique knowledge, 5+ years in large-scale compute infra, and experience with distributed training and debugging tools. Equity and competitive benefits are provided.

Qualifications

• BS or similar background in Computer Science or related area (or equivalent experience).
• Minimum 5+ years of experience designing and operating large scale compute infrastructure.
• Strong understanding of modern ML techniques and tools.
• Experience investigating, and resolving, training & inference performance end to end.
• Debugging and optimization experience with NSight Systems and NSight Compute.
• Experience with debugging large-scale distributed training using NCCL.
• Proficiency in programming & scripting languages such as Python, Go, Bash, as well as familiarity with cloud computing platforms (e.g., AWS, GCP, Azure) and parallel computing frameworks.
• Dedication to ongoing learning and staying updated on new technologies in AI/ML infrastructure.
• Excellent communication and collaboration skills.

Responsibilities

• Collaborate closely with AI/ML researchers to improve model efficiency and productivity.
• Build tools and frameworks to detect efficiency bottlenecks and deliver improvements.
• Work on diverse ML workloads across Robotics, AV, LLMs, Videos, and more.
• Collaborate across engineering to optimize hardware, software, and infrastructure usage.
• Monitor fleet-wide utilization patterns and implement scalable solutions.
• Stay up-to-date with AI/ML tech and advocate to integrate them within the org.

Skills

Python

Go

Bash

CUDA

NVIDIA NCCL

NSight

Education

BS in Computer Science or related field

Tools

NSight Systems

NSight Compute

NCCL

PyTorch

TensorFlow

Lustre/GPFS

InfiniBand (IBOP/RDMA)

AWS/GCP/Azure

Job description

NVIDIA is seeking a Senior AI/ML Performance and Efficiency Engineer for GPU Clusters to advance AI efficiency across researchers. You will collaborate with researchers to pinpoint infrastructure gaps, build tools, and deliver scalable solutions enhancing AI/ML workloads on GPU clusters.

The role requires strong ML technique knowledge, 5+ years in large-scale compute infra, and experience with distributed training and debugging tools. Equity and competitive benefits are provided.