Senior Math Libraries Engineer - Dense Linear Algebra

NVIDIA AI; Santa Clara (UT); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity and benefits

Job summary

NVIDIA is seeking software engineers to design, develop, and optimize dense linear algebra kernels for high-performance libraries such as cuSOLVER. You will work with a team to implement scalable GPU software and guide engineers while aligning with product roadmaps.

The role requires 5+ years of experience in numerical linear algebra on HPC systems, strong C++ and CUDA skills, and a track record of collaboration across teams.

Qualifications

• PhD or MSc in Computational Science and Engineering, Computer Science, Applied Mathematics, or related field (or equivalent).
• 5+ years of experience developing, debugging and optimizing high-performance numerical linear algebra software using C++ and parallel programming (CUDA, MPI, OpenMP, OpenACC, pthreads).
• Strong fundamentals in numerical methods and dense linear algebra libraries.

Responsibilities

• Designing, implementing and optimizing scalable high-performance numerical dense linear algebra software on GPUs.
• Provide technical leadership to library engineers, QA, and interns.
• Collaborate with product management to shape feature and performance roadmaps.

Skills

C++

CUDA

MPI

OpenMP

OpenACC

Pthreads

Numerical linear algebra

LAPACK/BLAS

Eigenvalue/SVDecompositions

Education

PhD or MSc in Computational Science and Engineering / Computer Science / Applied Mathematics

Tools

BLAS

LAPACK

PBLAS

SCALAPACK

Job description

We are looking for software engineers to join our development efforts in the area of dense linear algebra kernels for high-performance libraries such as cuSOLVER. Around the world, leading commercial and academic organizations are revolutionizing AI, data analytics, and scientific and engineering simulations, using data centers powered by GPUs and high-performance linear algebra libraries. Applications of these technologies include computer aided engineering (CAE), electronic design automation (EDA), quantum chemistry, autonomous vehicles, LLMs, computer vision, encryption, and countless others. Did you know our team develops the GPU accelerated libraries and SDKs that help make these possible?

In this role, you will work together with other developers on designing, developing, and optimizing kernels for various algorithms including triangular factorizations, eigenvalue decompositions and singular value decompositions. Ideal candidates will not only have experience developing accelerated computing kernels, but also be motivated to advance the state-of-the-art in a variety of accelerated computing domains. If this sounds exciting, we would love to meet you!

What You Will Be Doing

• Designing, implementing and optimizing scalable high-performance numerical dense linear algebra software on GPUs
• Providing technical leadership and guidance to library engineers, QA engineers, and interns working with you on projects
• Working closely with product management and other internal and external partners to understand feature and performance requirements and contribute to the technical roadmaps of libraries
• Finding and realizing opportunities to improve library quality, performance and maintainability through re-architecting and establishing innovative software development practices

What We Need To See

• PhD or MSc degree in Computational Science and Engineering, Computer Science, Applied Mathematics, or related science or engineering field (or equivalent experience)
• 5+ years of overall experience in developing, debugging and optimizing high-performance numerical linear algebra software using C++ and parallel programming; ideally using CUDA, MPI, OpenMP, OpenACC, pthreads
• Strong fundamentals in numerical methods such as computational linear algebra, linear system solvers, and methods for eigenvalue, singular value, and other decompositions
• Experience developing dense linear algebra libraries such as BLAS, LAPACK; and their parallel counterparts like PBLAS and SCALAPACK
• Strong collaboration, communication, and documentation habits

Ways To Stand Out From The Crowd

• Good knowledge of CPU and/or GPU hardware architecture
• Experience with adopting and advancing, software development practices such as CI/CD systems and project management tools such as JIRA.
• Experience with working in a globally distributed organization
• Strong background of large-scale computing technologies such as PDE solvers, eigenvalue solvers and time-domain simulation methods (e.g., CFD, FEA)

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing for science and engineering. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We're looking to grow our company and build our teams with the smartest people in the world! Join us at the forefront of technological advancement.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 9, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.