Senior Manager, GPU and AI Architecture, Senior Manager, GPU and AI Architecture

NVIDIA Corporation

Santa Clara (CA)

On-site

USD 272,000 - 431,250

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Eligible for equity
Competitive benefits

Job summary

A leading technology company in California seeks a Senior Manager for GPU and AI architecture. This role involves managing a high-performance team and shaping AI training platforms. The ideal candidate has extensive management and industry experience, with a deep understanding of GPU architectures and AI training workloads. Exceptional interpersonal skills and a passion for innovation are essential. Competitive salary range is $272,000 - $431,250 for Level 4. Equity and benefits are included. Applications are accepted until January 13, 2026.

Qualifications

  • 4+ years of relevant management experience.
  • 10+ years of total industry experience.
  • Hands-on experience with AI training workloads.

Responsibilities

  • Analyze and guide strategic decisions on AI accelerator roadmap.
  • Develop performance models and simulation environments.
  • Collaborate with cross-functional teams providing AI training expertise.
  • Lead a high-performance engineering team.

Skills

Expertise in GPU and AI accelerator architectures
Deep learning and AI knowledge
Performance analysis skills
Interpersonal skills

Education

MS or PhD in Computer Science, Electrical Engineering or related fields

Job description

We are now looking for a Senior Manager, for GPU and AI Architecture!

NVIDIA is seeking an experienced and innovative leader in GPU and AI architecture and systems performance to manage, mentor, and grow a world‑class engineering team. You will play a pivotal role in shaping NVIDIA's next‑generation AI training platforms, spanning advanced GPUs, innovative systems, and cutting‑edge software stacks. If you thrive managing agile teams tackling the challenges of designing future‑oriented AI platforms in a rapidly evolving landscape, we want to hear from you.

What You Will Be Doing
  • Analyze and anticipate leading‑edge AI training workloads on future GPU architectures to guide strategic decisions on NVIDIA’s AI accelerator roadmap.
  • Drive the development and refinement of sophisticated performance models, simulation environments, and infrastructure critical for future GPU designs.
  • Collaborate closely with cross‑functional teams across hardware design, architecture, software, and product management, providing deep AI training expertise.
  • Propose, evaluate, and advocate for groundbreaking hardware, system, and software innovations aimed at significantly enhancing AI training performance and efficiency.
  • Lead and scale a high‑performance team of engineers, overseeing their career growth, performance management, recruitment, strategic goal‑setting, and project delivery.
What We Want To See
  • An MS or PhD (or equivalent experience) in Computer Science, Electrical Engineering, Computer Engineering, or related fields, with 4+ years of relevant management experience and at least 10 years of total industry experience.
  • Proven expertise in GPU and AI accelerator architectures, with a robust understanding of hardware‑software interactions.
  • Deep knowledge and hands‑on experience with deep learning and AI, particularly in the context of large‑scale AI training workloads.
  • Solid track record in performance analysis, including familiarity with profiling tools and methodologies for evaluating complex AI systems.
  • Demonstrated success in managing and expanding impactful technical teams, with a clear passion for developing talent and fostering team success.
  • Exceptional interpersonal skills and a strong drive to achieve results through collaboration and leadership.

NVIDIA is widely considered to be one of the technology world’s most desirable employers with some of the most forward‑thinking and hardworking people in the world working here. If you're driven by innovation, love building and mentoring a team and passionate about the opportunity to shape the future of AI hardware and software, we'd love to hear from you! Come join NVIDIA and contribute directly to the technology empowering revolutionary breakthroughs in artificial intelligence.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 431,250 USD for Level 4, and 320,000 USD - 488,750 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until January 13, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Training Performance Architect
Senior AI Training Performance Architect

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 356,500
Equity
Benefits
Manager, Software Engineering
Manager, Software Engineering

NVIDIA Corporation • Austin (TX)

On-site
USD 224,000 - 431,000
Distinguished Engineer – High Performance AI
Distinguished Engineer – High Performance AI

NVIDIA Corporation • Texas

On-site
USD 320,000 - 488,750
Equity options
Generous benefits package
Competitive salaries
Senior High Performance AI Engineer
Senior High Performance AI Engineer

NVIDIA Corporation • California

On-site
USD 184,000 - 287,500
Equity options
Generous benefits package
Manager, Software Engineering
Manager, Software Engineering

NVIDIA Corporation • Westford (MA)

On-site
USD 224,000 - 431,000
Equity
Benefits
Manager, Software Engineering
Manager, Software Engineering

NVIDIA Corporation • Colorado

On-site
USD 224,000 - 431,000
Equity
Benefits
Principal Software Engineer
Principal Software Engineer

NVIDIA Corporation • Redmond (WA)

On-site
USD 272,000 - 431,000
Equity
Benefits
Senior Solutions Architect, Generative AI
Senior Solutions Architect, Generative AI

NVIDIA Corporation • California

Hybrid
USD 184,000 - 356,500
Senior Architect - Data Processing Systems, Analytics and Data Intelligence
Senior Architect - Data Processing Systems, Analytics and Data Intelligence

NVIDIA Corporation • United States

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior AI Training Performance Architect
Senior AI Training Performance Architect

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 210,000 - 340,000
Equity
Benefits