Senior Math Libraries Engineer – AI and HPC

NVIDIA; California (MO); On-site; USD 184,000 - 287,500; Full time

Benefits offered by this job

Equity and benefits

Competitive salary package

Job summary

A leading technology company is looking for a Senior Engineer in California to work on kernel generation for AI and HPC software. Responsibilities include designing high-performance numerical software, leading project teams, and mentoring engineers. Required qualifications include a degree in computer science or similar, 8+ years of HPC software experience using C++, and strong leadership skills. The role offers a competitive salary range from USD 184,000 to USD 287,500.

Qualifications

• 8+ years of experience in designing, developing, and optimizing HPC software using C++.
• Strong fundamentals in kernel generation and library design for linear algebra.
• Leadership skills in driving software development projects.

Responsibilities

• Design high-performance numerical dense linear algebra software on GPUs.
• Lead projects that involve multiple engineers.
• Oversee technical aspects and mentor junior engineers.

Skills

CUDA

C++

HPC software

Kernel generation

Leadership

Parallel programming

Machine Learning

Deep Learning

Python

Education

PhD, Master's, or Bachelor's degree in Computer Science, Applied Math, or related field

Tools

JIRA

Job description

About the Role

NVIDIA Math Libraries team is looking for a senior engineer to join our development efforts in the area of kernel generation for AI and HPC, specifically targeting matrix operations, JITing and fusions. Around the world, leading commercial and academic organizations are revolutionizing AI, scientific and engineering simulations, and data analytics, using data centers powered by GPUs. Applications of these technologies are in healthcare, NLP, VR, deep learning, autonomous vehicles and countless others. Our team develops the GPU accelerated mathematical libraries that makes all of this possible.

What You Will Be Doing

• Scoping, designing, and implementing high quality and performance numerical dense linear algebra software on GPUs.
• Owning the execution of projects involving multiple engineers and sometimes teams.
• Providing technical leadership and feedback to library engineers working with you on projects and sometimes mentor interns.
• Working closely with product management and other internal and external customers to understand feature and performance requirements and contribute to the technical roadmaps of libraries.
• Finding opportunities to improve library performance and reduce code maintenance overhead through re-architecting.
• To be successful in your responsibilities which are by nature sophisticated, you will need to find and explain complex solutions, exercise leadership, and coordinate with multiple teams to work towards your goals.

What We Need To See

• PhD, Master’s, or Bachelor's degree in Computer Science, Applied Math, or related science or engineering field of study (or equivalent experience).
• 8+ years of experience in designing, developing, testing, maintenance, and performance optimization of HPC software using C++.
• Strong fundamentals in kernel generation and composable library design for linear algebra.
• Leadership skills in driving software development projects.
• Strong collaboration, communication, and documentation habits.
• Kernel generation. JIT focus/experience desired.

Ways To Stand Out From The Crowd

• Experience with parallel programming, ideally using CUDA, MPI, OpenMP, OpenACC, pthreads.
• Good understanding of Machine Learning and Deep Learning technologies as well as knowledge of GPU (preferred) or CPU hardware architecture.
• Experience with low level programming using assembly for performance optimization and operator fusion is a huge plus.
• Experience with agile software development practices using project management tools such as JIRA.
• A scripting language, preferably Python.

Benefits

• Competitive salary package with base salary range of USD 184,000 - 287,500 for Level 4, and USD 224,000 - 356,500 for Level 5.
• Eligible for equity and benefits.

EEO Statement

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.