Senior LLM Training Performance Architect

NVIDIA Corporation; United States; Hybrid; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits package

Job summary

NVIDIA is seeking a Senior High-Performance LLM Training Engineer to optimize its training stack for thousands of GPUs. You will analyze, profile, and optimize AI training workloads across drivers and DL frameworks such as PyTorch and JAX.

This role involves implementing production-quality software, supporting MLPerf submissions, and building tools to automate workload analysis. NVIDIA offers equity, benefits, and a hybrid work model in a fast‑moving AI environment.

Qualifications

• PhD in CS/EE/CE with 5+ years; or MS with 8+ years of relevant experience.
• Strong background in deep learning and neural networks, especially training.
• Deep background in GPU architecture and fundamentals of GPU hardware.
• Proven experience analyzing and tuning application performance & system-level performance modelling.
• Programming skills in C++, Python, and CUDA.

Responsibilities

• Understand, analyze, profile, and optimize AI training workloads on innovative hardware and software platforms.
• Understand the big picture of training performance on GPUs, prioritizing and then solving problems across all state-of-the-art neural networks.
• Implement production-quality software in multiple layers of NVIDIA's deep learning platform stack, from drivers to DL frameworks.
• Build and support NVIDIA submissions to the MLPerf Training benchmark suite.
• Implement key DL training workloads in NVIDIA's proprietary processor and system simulators to enable future architecture studies.
• Build tools to automate workload analysis, workload optimization, and other critical workflows.

Skills

Deep learning

Neural networks

Performance analysis

Computer architecture

Profiling & optimization

C++

Python

CUDA

Education

PhD in Computer Science / Electrical Engineering / Computer Engineering

MS in related field with 8+ years experience

Tools

CUDA

Job description

NVIDIA is seeking a Senior High-Performance LLM Training Engineer to optimize its training stack for thousands of GPUs. You will analyze, profile, and optimize AI training workloads across drivers and DL frameworks such as PyTorch and JAX.

This role involves implementing production-quality software, supporting MLPerf submissions, and building tools to automate workload analysis. NVIDIA offers equity, benefits, and a hybrid work model in a fast‑moving AI environment.