Senior Deep Learning Performance Architect

NVIDIA; Santa Clara (CA); On-site; USD 184,000 - 287,500; Full time

Benefits offered by this job

Equity benefits

Comprehensive health benefits

Job summary

NVIDIA is on the lookout for a Senior Deep Learning Performance Architect to enhance the performance and efficiency of AI workloads. You'll analyze and develop cutting-edge architectures, optimize large-scale deep learning models, and work closely with cross-functional teams.

Ideal candidates should possess an MS or PhD in a relevant field, and have over 5 years of relevant experience in GPU/ASIC architecture and performance engineering. Attractive salary range and equity benefits offered.

Qualifications

• 5+ years of hands-on experience in GPU/ASIC architecture, parallel computing, or system performance engineering.
• Experience with deep learning workloads in production environments.
• Ability to work across teams and drive decisions in fast-paced environments.

Responsibilities

• Design and evaluate hardware architectures to improve performance.
• Analyze and optimize large-scale deep learning workloads.
• Identify and resolve system bottlenecks across compute and memory.

Skills

GPU/ASIC architecture

Parallel computing

Performance tuning

Python

C++

Education

MS or PhD in a relevant field

Job description

We are now looking for a Senior Deep Learning Performance Architect!

NVIDIA is seeking outstanding Performance Architects to help analyze and develop the next generation of architectures that accelerate AI and high-performance computing applications. Intelligent machines powered by Artificial Intelligence computers that can learn, reason and interact with people are no longer science fiction. GPU Deep Learning has provided the foundation for machines to learn, perceive, reason and solve problems. NVIDIA's GPUs run AI algorithms, simulating human intelligence, and act as the brains of computers, robots and self-driving cars that can perceive and understand the world. Come, join our Deep Learning Architecture team, where you can help build real-time, cost-effective computing platforms driving our success in this exciting and rapidly growing field!

What you’ll be doing

• Design and evaluate hardware architectures to improve performance, efficiency, and scalability of production AI workloads.
• Analyze and optimize large-scale deep learning workloads, especially LLM inference/training in real-world deployments.
• Build and use performance and power models (Python/C++) to drive architecture and product decisions.
• Identify and resolve system bottlenecks across compute, memory, and interconnect.
• Evaluate PPA trade-offs and guide feature prioritization for next-generation GPU/ASIC designs.
• Partner closely with software, systems, and product teams to align hardware capabilities with workload requirements.

What we need to see

• MS or PhD in a relevant field (Computer Science, Electrical Engineering, Computer Engineering, etc) or equivalent experience.
• 5+ years of hands‑on experience in GPU/ASIC architecture, parallel computing, or system performance engineering.
• Experience with deep learning workloads in production environments (training and/or inference).
• Proficiency in Python and C++ for building performance models, simulators, or analysis tools.
• Solid understanding of system architecture: memory hierarchy, data movement, and scalability.
• Prior experience debugging, profiling, and performance tuning on real systems.
• Ability to work across team and drive decisions in fast‑paced product environments.

Ways to stand out from the crowd

• Experience translating workload behavior into concrete hardware or system-level improvements.
• Practical experience with LLM inference optimization: batching, disaggregation, KV-cache management, latency/throughput tuning.
• Familiarity with production inference systems (e.g., scheduling, multi-node scaling, resource utilization)

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until May 9, 2026.

This posting is for an existing vacancy.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.