Senior Deep Learning Performance Architect - LPU

NVIDIA; United States; On-site; USD 152,000 - 288,000; Full time

Benefits offered by this job

Job summary

NVIDIA Corporation in the United States is seeking a Senior Deep Learning Performance Architect to push AI Inference performance across GPUs and hardware-software co-design. You will develop performance strategies and guide future GPU architecture decisions, working with cross-functional teams.

The role requires a strong ML/DL math foundation, expertise in C/C++/Python, CUDA familiarity, and a proven track record modeling LLM performance.

Qualifications

• MS/PhD in CS/EE/Math or equivalent with 5+ years of relevant experience.
• Strong foundation in machine learning and deep learning mathematics.
• Expert programming in C, C++, and Python.
• Familiarity with CUDA and HPC stacks (MPI/OpenMP).
• Solid knowledge of computer architecture.

Responsibilities

• Design novel GPU and system architectures to advance AI Inference performance and efficiency.
• Construct, investigate, and test popular deep learning algorithms and applications.
• Understand hardware-software interactions shaping future algorithms and apps.
• Build power and performance models for AI inference stacks to guide HW design.
• Collaborate across software, research, and product teams to steer AI direction.

Skills

Machine learning fundamentals

C/C++/Python programming

GPU computing (CUDA)

HPC (MPI/OpenMP)

Computer architecture knowledge

Mathematical foundations (ML/DL)

Performance modeling

Education

MS or PhD in CS/EE/Math or equivalent

Job description

We are now looking for a Senior Deep Learning Performance Architect! NVIDIA seeks a Senior DL Performance Architect to join our group of pioneers who enjoy pushing AI Inference performance boundaries. Our team focuses on ambitious hardware-software co-design to speed AI Inference workloads. This role gives an outstanding opportunity to develop world-class performance strategies, guide future GPU architecture decisions, and lead AI innovation. If you are passionate about AI efficiency Pareto curves, have a proven record of modeling LLM performance and architecting AI systems, and enjoy optimizing every cycle, this role may be perfect for you!

What you'll be doing:

• Design novel GPU and system architectures to advance the forefront of AI Inference performance and efficiency
• Construct, investigate, and test popular deep learning algorithms and applications
• Understand and analyze the relationship between hardware and software architectures as it influences future algorithms and applications
• Build efficient power and performance models of AI inference stack, while capturing minimal but significant information to guide next-gen HW architecture
• Collaborate across the company to guide the direction of AI, working with software, research, and product teams

What we need to see:

• A MS or PhD in a relevant field (CS, EE, Math) or equivalent experience, with 5+ years of relevant experience
• Strong mathematical foundation in machine learning and deep learning
• Expert programming skills in C, C++, and/or Python
• Familiarity with GPU computing (CUDA or similar) and HPC (MPI, OpenMP) stack
• Strong knowledge and coursework in computer architecture

Ways to stand out from the crowd:

• Background with systems-level performance modeling, profiling, and analysis
• Experience in characterizing and modeling system-level performance, accomplishing comparison studies, and documenting and publishing results
• Background in improving AI Inference workloads by developing CUDA kernels or compilers for custom ASIC hardware

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 152,000 USD - 241,500 USD for Level 3; and 184,000 USD - 287,500 USD for Level 4.

• You will also be eligible for equity and benefits.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer.

As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.