Senior Manager, GPU and AI Architecture, Senior Manager, GPU and AI Architecture

NVIDIA

Santa Clara (CA)

On-site

USD 272,000 - 431,250

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Eligible for equity
Competitive benefits

Job summary

A leading technology company in California seeks a Senior Manager for GPU and AI architecture. This role involves managing a high-performance team and shaping AI training platforms. The ideal candidate has extensive management and industry experience, with a deep understanding of GPU architectures and AI training workloads. Exceptional interpersonal skills and a passion for innovation are essential. Competitive salary range is $272,000 - $431,250 for Level 4. Equity and benefits are included. Applications are accepted until January 13, 2026.

Qualifications

  • 4+ years of relevant management experience.
  • 10+ years of total industry experience.
  • Hands-on experience with AI training workloads.

Responsibilities

  • Analyze and guide strategic decisions on AI accelerator roadmap.
  • Develop performance models and simulation environments.
  • Collaborate with cross-functional teams providing AI training expertise.
  • Lead a high-performance engineering team.

Skills

Expertise in GPU and AI accelerator architectures
Deep learning and AI knowledge
Performance analysis skills
Interpersonal skills

Education

MS or PhD in Computer Science, Electrical Engineering or related fields

Job description

We are now looking for a Senior Manager, for GPU and AI Architecture!

NVIDIA is seeking an experienced and innovative leader in GPU and AI architecture and systems performance to manage, mentor, and grow a world‑class engineering team. You will play a pivotal role in shaping NVIDIA's next‑generation AI training platforms, spanning advanced GPUs, innovative systems, and cutting‑edge software stacks. If you thrive managing agile teams tackling the challenges of designing future‑oriented AI platforms in a rapidly evolving landscape, we want to hear from you.

What You Will Be Doing
  • Analyze and anticipate leading‑edge AI training workloads on future GPU architectures to guide strategic decisions on NVIDIA’s AI accelerator roadmap.
  • Drive the development and refinement of sophisticated performance models, simulation environments, and infrastructure critical for future GPU designs.
  • Collaborate closely with cross‑functional teams across hardware design, architecture, software, and product management, providing deep AI training expertise.
  • Propose, evaluate, and advocate for groundbreaking hardware, system, and software innovations aimed at significantly enhancing AI training performance and efficiency.
  • Lead and scale a high‑performance team of engineers, overseeing their career growth, performance management, recruitment, strategic goal‑setting, and project delivery.
What We Want To See
  • An MS or PhD (or equivalent experience) in Computer Science, Electrical Engineering, Computer Engineering, or related fields, with 4+ years of relevant management experience and at least 10 years of total industry experience.
  • Proven expertise in GPU and AI accelerator architectures, with a robust understanding of hardware‑software interactions.
  • Deep knowledge and hands‑on experience with deep learning and AI, particularly in the context of large‑scale AI training workloads.
  • Solid track record in performance analysis, including familiarity with profiling tools and methodologies for evaluating complex AI systems.
  • Demonstrated success in managing and expanding impactful technical teams, with a clear passion for developing talent and fostering team success.
  • Exceptional interpersonal skills and a strong drive to achieve results through collaboration and leadership.

NVIDIA is widely considered to be one of the technology world’s most desirable employers with some of the most forward‑thinking and hardworking people in the world working here. If you're driven by innovation, love building and mentoring a team and passionate about the opportunity to shape the future of AI hardware and software, we'd love to hear from you! Come join NVIDIA and contribute directly to the technology empowering revolutionary breakthroughs in artificial intelligence.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 431,250 USD for Level 4, and 320,000 USD - 488,750 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until January 13, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Training Performance Architect
Senior AI Training Performance Architect

Nvidia Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Senior AI Training Performance Architect
Senior AI Training Performance Architect

NVIDIA • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
GPU System Performance Architect
GPU System Performance Architect

NVIDIA • Santa Clara (CA)

On-site
USD 224,000 - 357,000
Equity
Benefits
Senior Software Architect, Networking AI
Senior Software Architect, Networking AI

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Senior High Performance AI Engineer
Senior High Performance AI Engineer

NVIDIA • California (MO)

On-site
USD 184,000 - 287,500
Equity options
Generous benefits package
Senior Software Architect, Networking AI
Senior Software Architect, Networking AI

NVIDIA • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Principal Software Engineer
Principal Software Engineer

NVIDIA • Santa Clara (CA)

On-site
USD 272,000 - 431,000
Equity
Benefits
Senior Solutions Architect, Generative AI
Senior Solutions Architect, Generative AI

NVIDIA • California (MO)

Hybrid
USD 184,000 - 357,000
Accelerated Computing GPU Product Manager
Accelerated Computing GPU Product Manager

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 168,000 - 328,000
Senior Staff Engineer - Employee Productivity
Senior Staff Engineer - Employee Productivity

NVIDIA • United States

On-site
USD 200,000 - 322,000