Senior Math Libraries Engineer - LLM Integration and Developer Experience

NVIDIA; New York (NY); On-site; USD 152,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking an engineer to accelerate API integration across the CUDA-X math library stack for LLM and agentic AI workflows. You will ensure high-performance applications via CUDA-X libraries, collaborating with stakeholders to deliver LLM-enhanced releases and build tooling to measure AI-generated code quality.

The role emphasizes API design, documentation, and scalable, explainable tooling, with a focus on LLM-first representations and cross-tool compatibilities.

Qualifications

• PhD or MSc in Computational Science, Computer Science, Applied Math, or related field preferred (or equivalent experience).
• 3+ years of experience in relevant roles.
• Robust knowledge of LLMs, finetuning, RL, building RAGs, MCP, and agenting tooling.
• Proven experience designing clear, composable APIs and writing high-quality, well-documented code.

Responsibilities

• Drive the architecture and implementation of math libraries APIs and documentation structures designed to be LLM-first.
• Work with internal and external stakeholders to deliver timely LLM-enhanced library releases.
• Build metrics, tools and processes to measure impact and quality of LLM/agentic code generation.
• Prototype tooling to transform APIs into LLM-friendly representations across codegen tools.

Skills

LLMs

Finetuning

Reinforcement Learning

RAGs

Agent tooling

API design

Education

PhD or MSc preferred in Computational Science / CS / Applied Math

Tools

CUDA-X APIs

cuBLAS

cuFFT

cuSOLVER

cuSPARSE

Job description

We are looking for a passionate and energized engineer to accelerate the integration of APIs across the CUDA-X math library software stack into modern LLM and agentic AI workflows. Leading organizations globally are using GPU-powered data centers for AI, data analytics, and scientific simulations, driving advancements in fields like LLMs, computer vision, CAE, EDA, and autonomous vehicles. Our team develops the GPU-accelerated libraries and SDKs essential for these technologies.

In this role, you will be responsible for ensuring both human engineers using LLMs and AI agents alike build high-performance applications with ease through effective utilization of CUDA-X libraries. Do you have the rare blend of technical, developer experience and communication skills? If so, we would love to learn more about you!

What You'll Be Doing

• Drive the architecture and implementation of math libraries APIs and documentation structures designed to be LLM-first: introspectable, explainable, and easily synthesized by AI agents.
• Work with internal and external stakeholders to deliver timely LLM-enhanced library releases.
• Build metrics, tools and processes to measure impact and quality of LLM/agentic code generation.
• Prototype tooling and solutions to help transform math libraries’ APIs into LLM-friendly representations across popular codegen tools.

What We Need To See

• PhD or MSc’s degree in Computational Science, Computer Science, Applied Math, or related science or engineering field of study is preferred (or equivalent experience)
• 3+ years of experience
• Robust knowledge of LLMs, finetuning, RL, building RAGs, MCP, and building agenting tooling
• Proven experience designing clear, composable APIs and writing high-quality, well-documented code for complex technical domains
• Ability to prioritize multiple projects and work independently with minimal direction
• Excellent collaboration, communication, and documentation habits

Ways To Stand Out From The Crowd

• Prior work in AI-assisted software engineering, code generation, or programming language design
• Familiarity with CUDA-X math library APIs: cuBLAS, cuFFT, cuSOLVER, cuSPARSE, etc.

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing for science and engineering. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We're looking to grow our company and build our teams with the smartest people in the world! Join us at the forefront of technological advancement. NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and talented people in the world working for us. If you're creative, autonomous and love a challenge, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 19, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.