Senior Math Libraries Engineer – AI and HPC

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 184,000 - 287,500; Full time

Job summary

NVIDIA Gruppe is looking for a senior engineer to join their Math Libraries team in Santa Clara, California. This role involves designing and implementing high-performance numerical linear algebra software on GPUs, with a strong focus on kernel generation.

The ideal candidate has over 8 years of experience in HPC software development using C++, along with leadership skills and a relevant degree. The position offers a competitive salary range and the opportunity to be part of cutting-edge AI and data center technologies.

Qualifications

• 8+ years of experience in designing, developing, testing, and optimizing HPC software.
• Strong fundamentals in linear algebra library design.
• Experience with kernel generation and JIT focus is desired.

Responsibilities

• Design and implement high-quality numerical dense linear algebra software on GPUs.
• Lead projects involving multiple engineers and coordinate efforts.
• Provide technical guidance to team members.

Skills

C++

HPC software development

Kernel generation

Leadership

Collaboration

Documentation

Education

PhD, Master’s, or Bachelor's degree in Computer Science, Applied Math, or related field

Tools

CUDA

MPI

OpenMP

JIRA

Python

Job description

NVIDIA Math Libraries team is looking for a senior engineer to join our development efforts in the area of kernel generation for AI and HPC, specifically targeting matrix operations, JITing and fusions. Around the world, leading commercial and academic organizations are revolutionizing AI, scientific and engineering simulations, and data analytics, using data centers powered by GPUs. Applications of these technologies are in healthcare, NLP, VR, deep learning, autonomous vehicles and countless others.

What you will be doing:

• Scoping, designing, and implementing high quality and performance numerical dense linear algebra software on GPUs.
• Owning the execution of projects involving multiple engineers and sometimes teams.
• Providing technical leadership and feedback to library engineers working with you on projects and sometimes mentor interns.
• Working closely with product management and other internal and external customers to understand feature and performance requirements and contribute to the technical roadmaps of libraries.
• Finding opportunities to improve library performance and reduce code maintenance overhead through re-architecting.
• Finding and explaining complex solutions, exercising leadership, and coordinating with multiple teams to work towards goals.

What we need to see:

• PhD, Master’s, or Bachelor's degree in Computer Science, Applied Math, or related science or engineering field of study (or equivalent experience).
• 8+ years of experience in designing, developing, testing, maintenance, and performance optimization of HPC software using C++.
• Strong fundamentals in kernel generation and composable library design for linear algebra.
• Leadership skills in driving software development projects.
• Strong collaboration, communication, and documentation habits.
• Experience with kernel generation, JIT focus/experience desired.

Ways to stand out from the crowd:

• Experience with parallel programming, ideally using CUDA, MPI, OpenMP, OpenACC, pthreads.
• Good understanding of Machine Learning and Deep Learning technologies as well as knowledge of GPU (preferred) or CPU hardware architecture.
• Experience with low level programming using assembly for performance optimization and operator fusion is a huge plus.
• Experience with agile software development practices using project management tools such as JIRA.
• Skilled in a scripting language, preferably Python.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is $184,000 – $287,500 for Level 4, and $224,000 – $356,500 for Level 5. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until April 12, 2026.

NVIDIA is committed to fostering a diverse work environment and is an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.