Senior AI Training Performance Architect — Optimize at Scale

NVIDIA Corporation; Santa Clara (CA); On-site; USD 210,000 - 340,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation in Santa Clara, CA is seeking a Senior AI Training Performance Architect to push the limits of AI training workloads. You will analyze, profile, and optimize across the hardware/software stack to extract peak performance for large-scale DL systems.

Join a team delivering production-quality software, contribute to MLPerf submissions, and influence roadmap decisions with deep expertise in deep learning, GPU architecture, and performance modeling.

Qualifications

• PhD in CS, EE or CSEE (or equivalent experience) with 5+ years of relevant experience; or MS with 8+ years of experience.
• Strong background in deep learning and neural networks, particularly in training.
• Solid understanding of computer architecture and familiarity with GPU architecture fundamentals.
• Proven background in analyzing and tuning application performance.
• Proven experience with processor and system-level performance modeling.
• Proficiency in programming with C++, Python, and CUDA.

Responsibilities

• Understand, analyze, profile, and optimize AI training workloads on state-of- the hardware and software platforms.
• Identifying performance bottlenecks of AI training on GPUs, prioritizing and then solving problems across the key AI training workloads.
• Implement production-quality software across multiple layers of NVIDIA's deep learning platform stack, from drivers to DL frameworks.
• Build and support NVIDIA submissions for MLPerf Training benchmarks.
• Implement key DL training workloads in NVIDIA's proprietary processor and system simulators to enable future architecture studies.
• Develop tools to automate workload analysis, optimization, and other critical workflows.

Skills

Deep learning

Neural networks

GPU architecture

Performance tuning

C++

Python

CUDA

Education

PhD in CS/EE/CSEE (or equivalent)

MS in CS/EE/CSEE (or equivalent)

Job description

NVIDIA Corporation in Santa Clara, CA is seeking a Senior AI Training Performance Architect to push the limits of AI training workloads. You will analyze, profile, and optimize across the hardware/software stack to extract peak performance for large-scale DL systems.

Join a team delivering production-quality software, contribute to MLPerf submissions, and influence roadmap decisions with deep expertise in deep learning, GPU architecture, and performance modeling.