Senior Software Engineer, CUDA C++ Core Libraries

NVIDIA Corporation

Santa Clara, Northern (CA, KY)

Hybrid

USD 184,000 - 357,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

NVIDIA Corporation seeks a Senior Software Engineer to advance the C++ foundation of CUDA Core Libraries in Santa Clara. Design and optimize high-performance algorithms and APIs for C++ developers, building foundational libraries and runtime infrastructure for GPU-accelerated software.

You will own features end-to-end—from design to release—while improving developer productivity through tests, benchmarks, and CI. Collaboration with Python/Rust teams and users is essential in this role.

Qualifications

  • BS/MS/PhD in CS/CE or related field with 8+ years of software-development experience.
  • Strong production programming skills in C and C++, with deep knowledge of modern C++.
  • Experience with generic programming, templates, type systems, and standard-library design principles.
  • Proven experience developing systems-level software with demanding performance, concurrency, and compatibility requirements.
  • Practical experience with CUDA or another parallel/heterogeneous programming environment.
  • Experience developing production software or foundational libraries, including testing, profiling, benchmarking, and code review.
  • Understanding of API/ABI compatibility and exposing C/C++ functionality to other languages.
  • Ability to work independently and drive complex work to completion.
  • Clear written communication for architecture documents, API specs, and developer docs.

Responsibilities

  • Design and implement foundational CUDA C++ libraries, parallel algorithms, utilities, and runtime abstractions.
  • Compose and optimize GPU algorithms from high-level interfaces to low-level implementations.
  • Design stable interoperability boundaries between C/C++ and Python/Rust.
  • Balance performance, compile time, portability, and long-term API evolution.
  • Own features through design, testing, profiling, documentation, and release."
  • Improve developer productivity via diagnostics, examples, tests, benchmarks, and CI.
  • Collaborate with Python, Rust, compiler, and runtime engineers during reviews.
  • Engage with users on performance investigations, API feedback, and correctness issues.

Skills

C/C++ programming
CUDA
Generic programming
Templates
APIs

Education

BS/MS/PhD in CS/CE or related field

Tools

Thrust
CUB
libcudaXX

Job description

NVIDIA’s accelerated computing platform is foundational to modern HPC and AI. At the center of this platform are CUDA Core Libraries that provide the algorithms, abstractions, and runtime capabilities needed to build fast, reliable, and scalable GPU-accelerated software. We are hiring a Senior Software Engineer to advance the C++ foundation of CUDA Core Libraries. You will design and optimize high-performance algorithms and APIs for C++ developers. You will join the team building the foundational libraries, algorithms, and language/runtime infrastructure that make CUDA a speed-of-light experience for developers and AI coding agents alike.

What you’ll be doing:
  • Design and implement foundational CUDA C++ libraries, parallel algorithms, utilities, and runtime abstractions.
  • Compose and optimize GPU algorithms from high-level generic interfaces through low-level implementation.
  • Design stable interoperability boundaries that allow core C/C++ functionality to be consumed efficiently from Python and Rust.
  • Balance performance, compile time, portability, compatibility, usability, and long-term API evolution.
  • Own features throughout their lifecycle: design, implementation, testing, profiling, benchmarking, documentation, release, and maintenance.
  • Improve developer productivity through diagnostics, examples, build integration, tests, benchmarks, and continuous integration.
  • Collaborate with Python, Rust, compiler, and runtime engineers during architecture, design, and code reviews.
  • Engage with users on performance investigations, API feedback, and correctness issues.
What we need to see:
  • BS, MS, or PhD in Computer Science, Computer Engineering, or a related field, or equivalent experience and 8+ years of relevant software-development experience.
  • Strong production programming skills in C and C++, with deep knowledge of modern C++.
  • Experience with generic programming, templates, type systems, and standard-library design principles.
  • Proven experience developing systems-level software with demanding performance, concurrency, and compatibility requirements.
  • Practical experience with CUDA or another parallel or heterogeneous programming environment.
  • Experience developing production software or foundational libraries, including testing, profiling, benchmarking, and code review.
  • Understanding of API and ABI compatibility and the challenges of exposing C/C++ functionality to other languages.
  • Ability to work independently, define project scope, and drive complex work to completion.
  • Clear written communication skills for architecture documents, API specifications, and developer documentation.
  • Comfort working in large C/C++ codebases with build systems, toolchains, and continuous-integration infrastructure.
Ways to stand out from the crowd:
  • Strong understanding of CPU/GPU architecture and performance optimization, with hands‑on experience in GPU‑accelerated stacks (CUDA C++/Python, PyTorch, JAX, Numba, CuPy, or similar).
  • Proficiency with modern C++ and GPU libraries such as Thrust, CUB, and libcudacxx.
  • Experience with compiler infrastructure and tooling, including LLVM, Clang, or MLIR.
  • Knowledge of binary interfaces, linking, versioning, cross-platform distribution, and interoperability across Python, Rust, and C/C++ stacks.
  • Demonstrated interest in developer tools, library design, and improving developer productivity.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until September 4, 2026. This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Learn more about NVIDIA.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Software Engineer, CUDA C++ Core Libraries
Senior Software Engineer, CUDA C++ Core Libraries

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior CUDA C++ Core Libraries Architect
Senior CUDA C++ Core Libraries Architect

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Software Engineer, CUDA Python Core Libraries
Senior Software Engineer, CUDA Python Core Libraries

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Software Engineer, CUDA Rust Core Libraries
Senior Software Engineer, CUDA Rust Core Libraries

NVIDIA Corporation • Santa Clara (CA), Northern (KY)

Hybrid
USD 184,000 - 357,000
Equity
Benefits
Senior Software Engineer, CUDA Rust Core Libraries
Senior Software Engineer, CUDA Rust Core Libraries

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Software Engineer - Python Numerical Computing Libraries
Senior Software Engineer - Python Numerical Computing Libraries

NVIDIA Corporation • Santa Clara (CA), Northern (KY)

Hybrid
USD 184,000 - 357,000
Senior Software Engineer, CUDA UMD - Graphs and GPU Sharing
Senior Software Engineer, CUDA UMD - Graphs and GPU Sharing

NVIDIA Corporation • Santa Clara (CA), Northern (KY)

Hybrid
USD 184,000 - 357,000
Senior Software Engineer CUDA UMD - GPU Kernel Scheduling
Senior Software Engineer CUDA UMD - GPU Kernel Scheduling

NVIDIA • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior Software Engineer CUDA UMD - GPU Kernel Scheduling
Senior Software Engineer CUDA UMD - GPU Kernel Scheduling

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior Software Engineer CUDA UMD - GPU Kernel Scheduling
Senior Software Engineer CUDA UMD - GPU Kernel Scheduling

Nvidia Corporation in • Santa Clara (CA)

On-site
USD 152,000 - 242,000
Equity
Benefits