Senior Math Libraries Engineer – Emulation in AI and HPC

NVIDIA; Town of Poland (NY); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Competitive salaries

Generous benefits package

Job summary

A leading technology company is seeking experienced software engineers for the math libraries team focused on AI and HPC kernel generation. The role involves scoping, designing, and implementing high-performance numerical software on GPUs, while providing technical leadership and mentoring. Ideal candidates have a PhD or Master’s degree in Computer Science or Applied Math and 5+ years of experience with CUDA and C++. Benefits include competitive salaries and a generous package.

Qualifications

• 5+ years of experience in software design, development, and optimization.
• Good knowledge of GPU or CPU hardware architecture.
• Great teamwork, communication, and documentation habits.

Responsibilities

• Scope, design, and implement high quality numerical software on GPUs.
• Provide technical leadership and mentor interns in projects.
• Work closely with product management to define technical roadmaps.
• Find opportunities to improve library performance through re-architecting.

Skills

CUDA

C++

Finite precision arithmetics

Teamwork

Education

PhD or Master’s degree in Computer Science or Applied Math

Job description

We are looking for software engineers to join our math libraries teams for AI and HPC kernel generation, specifically targeting emulation of math operations across different precisions. If the idea of tinkering with bits and precision formats in math operations and applying your knowledge to develop and optimize algorithms to make an impact around the world excites you, come and join our team!

What You Will Be Doing

• Scoping, designing, and implementing high quality and performance numerical dense linear algebra software on GPUs.
• Providing technical leadership and feedback to library engineers working with you on projects and sometimes mentor interns.
• Working closely with product management and other internal and external customers to understand feature and performance requirements and help define the technical roadmaps of libraries.
• Finding opportunities to improve library performance and reduce code maintenance overhead through re-architecting.

What We Need To See

• PhD or Master’s degree in Computer Science, Applied Math, or related science or engineering field of study (or equivalent experience).
• 5+ years of experience in designing, developing, testing, maintenance, and performance optimization of production software using CUDA and C++.
• Good knowledge of GPU (preferred) or CPU hardware architecture.
• Strong fundamentals in finite precision arithmetics and numerical methods for linear algebra.
• Great teamwork, communication, and documentation habits.

Ways To Stand Out From The Crowd

• Experience with CUTLASS, or low level programming like assembly for performance optimization is a huge plus.
• A scripting language, preferably Python.
• Experience with working in a globally-distributed team.

Benefits

Competitive salaries and a generous benefits package.