AI Hardware Architect

NVIDIA Corporation; Santa Clara (CA); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking an AI Hardware Architect in Santa Clara to design and optimize next‑gen AI hardware, including GPUs and CPUs. You will study workloads, propose microarchitectural solutions, and collaborate with software, firmware, and platform teams to improve performance, power, and security across SOCs.

The role requires a Master’s in CE/EE with 8+ years of relevant experience, strong coding skills, and a deep understanding of LLMs.

Qualifications

• Master's degree in Computer Engineering or Electrical Engineering or equivalent experience
• 8+ years of relevant industry experience
• Experience building high performance microarchitectural structures
• Clear understanding of performance, power and security implications of microarchitectural features
• Excellent coding and algorithmic thinking skills
• Good understanding of LLMs

Responsibilities

• Work on groundbreaking GPU and CPU systems
• Analyze and identify areas for improvement across disciplines
• Study applications and models running on Nvidia hardware and their architectural implications
• Develop microarchitectural solutions for connectivity, coherency, power management, security, and memory management
• Collaborate with software, firmware, platform and cross-functional teams on system architecture
• Model, analyze, and explain performance and power advantages
• Guide customers and firmware engineers to optimize performance

Skills

Microarchitecture

Performance analysis

Power management

Security implications

Communication

Coding

LLMs understanding

Education

Master's degree in Computer Engineering or Electrical Engineering

Tools

Bus protocols knowledge

Chip design tools

Job description

NVIDIA is hiring an AI Hardware Architect to analyze and architect the next generation of Artificial Intelligence hardware. We are looking for special individuals with a passion for delivering innovative products. Together, we will build life-changing AI chips and chiplets for the rapidly growing AI infrastructure market. If you have knowledge of computer architecture, microarchitecture, and chip design, and are looking to learn and grow, this is the opportunity you are looking for.

What you'll be doing:

• Work on groundbreaking GPU and CPU systems.
• Understand them across a range of disciplines and identify areas for improvement.
• Study the applications and models running on Nvidia hardware and their architectural implications.
• Come up with microarchitectural solutions for connectivity, coherency, power management, security, memory management and other SOC level issues.
• Understand and help drive implementation of bus protocols, networking protocols, memory access and security solutions across a range of products.
• Work with software, firmware, platform and multi-functional teams on system architecture.
• Model, analyze, and explain the performance and power advantages of Nvidia solutions.
• Guide customers and firmware engineers to extract the most performance from microarchitectural structures.

What we need to see:

• Master's Degree in Computer Engineering or Electrical Engineering (or equivalent experience) 8+ years of relevant industry experience.
• Experience building high performance microarchitectural structures.
• Experience with industry standard bus protocols.
• Clear understanding of the performance, power and security implications of microarchitectural features.
• Strong interpersonal, communication and teamwork skills.
• A drive to continuously learn and expand architectural breadth and depth.
• Excellent coding and algorithmic thinking skills.
• Good understanding of LLMs.
• Publications or other evidence of original chip/system architecture work is a plus.

Join the future of chip building, you will contribute to innovative products with a dedicated team!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 20, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Learn more about NVIDIA.