Senior Math Libraries Engineer - Sparse Linear Algebra

NVIDIA Corporation; Santa Clara (CA); On-site; USD 152,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation is seeking software engineers to advance sparse linear algebra kernels for cuSPARSE and cuDSS. You will design, implement, and optimize high-performance algorithms on current and future GPU architectures, collaborating with engineers, QA, and partners to shape feature roadmaps.

The role emphasizes strong fundamentals in floating point arithmetic and experience with CUDA, MPI, OpenMP, or similar tools.

Qualifications

• PhD or MSc in Computational Science and Engineering, Computer Science, Applied Mathematics, or related field is preferred.
• 5+ years of experience developing and optimizing high-performance sparse linear algebra software using C++ and parallel programming.
• Strong fundamentals in floating point arithmetic and sparse primitives like matrix-vector products.

Responsibilities

• Design, implement and optimize scalable high-performance sparse linear algebra software for GPU architectures.
• Collaborate with library engineers, QA, and partners on feature and performance roadmaps.
• Contribute to code quality, performance, and maintainability through innovative practices.
• Work with CI/CD and project management tools to streamline development.

Skills

CUDA

MPI/OpenMP

Floating point arithmetic

Sparse linear algebra

Education

PhD or MSc in Computational Science and Engineering

Job description

We are looking for software engineers to join our development efforts in the area of sparse linear algebra kernels for high-performance libraries such as cuSPARSE and cuDSS. Around the world, leading commercial and academic organizations are revolutionizing AI, data analytics, and scientific and engineering simulations, using data centers powered by GPUs and high-performance linear algebra libraries. Applications of these technologies include computer aided engineering (CAE), electronic design automation (EDA), quantum chemistry, autonomous vehicles, LLMs, and countless others. Did you know our team develops the GPU accelerated libraries and SDKs that help make these possible?

What you will be doing

• Designing, implementing and optimizing scalable high-performance numerical sparse linear algebra software for existing and future GPU architectures
• Working with library engineers, QA engineers, and interns on topics ranging from sparse BLAS operations to advanced direct and iterative sparse solvers
• Working closely with product management and other internal and external partners to understand feature and performance requirements and contribute to the technical roadmaps of libraries
• Finding and realizing opportunities to improve library quality, performance and maintainability through re-architecting and establishing innovative software development practices

What we need to see

• PhD or MSc degree (or equivalent experience) in Computational Science and Engineering, Computer Science, Applied Mathematics, or related science or engineering field is preferred
• 5+ years of overall experience in developing, debugging and optimizing high-performance sparse linear algebra software using C++ and parallel programming; ideally using CUDA, MPI, OpenMP, OpenACC, pthreads, or equivalent technologies
• Strong fundamentals in floating point arithmetic and implementation of sparse linear algebra primitives like matrix-vector and matrix-matrix products
• Experience in developing , maintaining, and testing sparse linear algebra libraries
• Strong collaboration, communication, and documentation habits.

Ways to stand out from the crowd

• Good knowledge of CPU and/or GPU hardware architecture and low-level GPU performance optimization
• Familiarity with technologies such as multi-frontal factorizations, iterative solvers, preconditioners, and algebraic multigrid
• Experience with adopting and advancing software development practices such as CI/CD systems and project management tools such as JIRA
• Understanding of large-scale computing technologies such as PDE solvers, eigenvalue solvers and time-domain simulation methods (e.g., CFD, FEA)
• Working experience in a globally distributed and agile organization

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing for science and engineering. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We're looking to grow our company and build our teams with the smartest people in the world! Join us at the forefront of technological advancement.

NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and talented people in the world working for us. If you're creative, autonomous and love a challenge, we want to hear from you!

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 152,000 USD – 241,500 USD for Level 3; and 184,000 USD – 287,500 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.