Senior Math Libraries Engineer – Emulation in AI and HPC

NVIDIA; Germany (OH); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive salaries

Generous benefits package

Job summary

A leading technology company is seeking software engineers for its math libraries teams focusing on AI and HPC kernel generation. The role involves developing algorithms for numerical dense linear algebra software on GPUs, providing leadership to library engineers, and collaborating with product management to meet performance requirements. Candidates should have a PhD or Master’s in a relevant field, along with strong CUDA and C++ skills. Competitive salaries and generous benefits are offered.

Qualifications

• 5+ years of experience in designing, developing, and optimizing production software.
• Good knowledge of GPU or CPU hardware architecture.
• Experience working with a globally-distributed team.

Responsibilities

• Scope, design, and implement numerical dense linear algebra software on GPUs.
• Provide leadership and feedback to engineers and mentor interns.
• Collaborate with product management to define feature requirements.
• Find opportunities to improve performance and reduce maintenance overhead.

Skills

CUDA

C++

Finite precision arithmetics

Numerical methods for linear algebra

Teamwork

Communication

Education

PhD or Master’s degree in Computer Science, Applied Math, or related field

Tools

CUTLASS

Python

Job description

We are looking for software engineers to join our math libraries teams for AI and HPC kernel generation, specifically targeting emulation of math operations across different precisions. If the idea of tinkering with bits and precision formats in math operations and applying your knowledge to develop and optimize algorithms to make an impact around the world excites you, come and join our team!

What You Will Be Doing

• Scoping, designing, and implementing high quality and performance numerical dense linear algebra software on GPUs.
• Providing technical leadership and feedback to library engineers working with you on projects and sometimes mentor interns.
• Working closely with product management and other internal and external customers to understand feature and performance requirements and help define the technical roadmaps of libraries.
• Finding opportunities to improve library performance and reduce code maintenance overhead through re-architecting.

What We Need To See

• PhD or Master’s degree in Computer Science, Applied Math, or related science or engineering field of study (or equivalent experience).
• 5+ years of experience in designing, developing, testing, maintenance, and performance optimization of production software using CUDA and C++.
• Good knowledge of GPU (preferred) or CPU hardware architecture.
• Strong fundamentals in finite precision arithmetics and numerical methods for linear algebra.
• Great teamwork, communication, and documentation habits.

Ways To Stand Out From The Crowd

• Experience with CUTLASS, or low level programming like assembly for performance optimization is a huge plus.
• A scripting language, preferably Python.
• Experience with working in a globally-distributed team.

Benefits

Competitive salaries and a generous benefits package.