Senior Software Engineer, CUTLASS Performance

NVIDIA

United States

Sur place

USD 152 000 - 288 000

Plein temps

14 jours+

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Avantages offerts par ce poste

Equity compensation
Benefits

Résumé du poste

NVIDIA Corporation in the United States is seeking a Deep Learning performance engineer to benchmark state-of-the-art models, identify fusion opportunities, and push CUTLASS kernel performance on GPUs.

You will collaborate across teams, develop tooling for automated benchmarking, and contribute to performance models, with equity and benefits as part of the compensation package. This role targets cutting-edge DL workloads and requires strong Python/C++ skills and GPU know-how.

Qualifications

  • Masters or PhD degree in Computer Science, Computer Engineering, or related field (or equivalent experience).
  • 3+ years of relevant industry experience.
  • Strong programming skills in Python and C++.
  • Experience in software performance analysis and optimization.
  • Deep understanding of computer architecture and familiarity with GPUs or similar parallel processing architectures.

Responsabilités

  • Benchmark the performance of state-of-the-art deep learning models' inference and training passes to identify key GPU kernel and fusion opportunities.
  • Identify gaps between theoretical and realized performance, and suggest software improvements or model adjustments to resolve them.
  • Develop tooling to automate the benchmarking, analysis, and performance optimization loop to push the limit of CUTLASS kernel performance within DL networks.
  • Be the authoritative resource on kernel performance in the team and engage with teams across NVIDIA including GPU architecture, DL frameworks, and QA as the performance representative for the CUTLASS team.

Connaissances

Python
C++
Performance analysis
GPU architectures
3+ years experience

Formation

Masters or PhD in CS/CE or related field

Description du poste

NVIDIA's high-performance computing platforms are powering the AI revolution across many applications and industries. Within our software stack, CUTLASS stands out as a popular open-source ecosystem dedicated to high-performance linear algebra and Tensor Core primitives. Since 2017, it has provided the community with C++ and Python abstractions to implement custom matrix multiply (GEMM) and related math and deep learning computations on NVIDIA GPUs.

What you'll be doing:
  • Benchmark the performance of state-of-the-art deep learning models' inference and training passes to identify key GPU kernel and fusion opportunities.
  • Identify gaps between theoretical and realized performance, and suggest software improvements or model adjustments to resolve them.
  • Develop tooling to automate the benchmarking, analysis, and performance optimization loop to push the limit of CUTLASS kernel performance within DL networks.
  • Be the authoritative resource on kernel performance in the team and engage with teams across NVIDIA including GPU architecture, DL frameworks, and QA as the performance representative for the CUTLASS team.
What we need to see:
  • Masters or PhD degree in Computer Science, Computer Engineering, or related field (or equivalent experience).
  • 3+ years of relevant industry experience.
  • Strong programming skills in Python and C++.
  • Experience in software performance analysis and optimization.
  • Deep understanding of computer architecture and familiarity with GPUs or similar parallel processing architectures.
Ways to stand out from the crowd:
  • Deep understanding of state-of-the art DL model architectures.
  • Hands-on experience with performance benchmarking of DL frameworks like PyTorch, JAX, SGLang, vLLM, TRT-LLM, or others.
  • Experience in developing performance models and performance regression systems.

NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and hard working people in the world working for us. If you're creative, autonomous, and love a challenge, consider joining our Deep Learning Library team and help us build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 152,000 USD - 241,500 USD for Level 3; and 184,000 USD - 287,500 USD for Level 4.

You will also be eligible for equity and benefits .

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Senior Software Engineer, CUTLASS Performance
Senior Software Engineer, CUTLASS Performance

NVIDIA Corporation • Durham (NC)

Sur place
USD 152 000 - 241 500
Senior Software Engineer, CUTLASS Performance
Senior Software Engineer, CUTLASS Performance

NVIDIA Corporation • Hillsboro (OR)

Sur place
USD 152 000 - 287 500
Senior Software Engineer, CUTLASS Performance
Senior Software Engineer, CUTLASS Performance

NVIDIA Corporation • Redmond (WA)

Sur place
USD 152 000 - 241 500
Senior Software Engineer, CUTLASS Performance
Senior Software Engineer, CUTLASS Performance

Talemexa • Hillsboro (OR)

Sur place
USD 152 000 - 288 000
Senior AI Frameworks Engineer
Senior AI Frameworks Engineer

NVIDIA • États-Unis

Sur place
USD 152 000 - 288 000
Senior Performance Engineer - Deep Learning
Senior Performance Engineer - Deep Learning

NVIDIA Corporation • Santa Clara (CA)

Sur place
USD 152 000 - 288 000
Performance Engineer - Deep Learning
Performance Engineer - Deep Learning

2100 NVIDIA USA • Santa Clara (CA)

Sur place
USD 124 000 - 242 000
Equity
Benefits
Senior High-Performance LLM Training Engineer
Senior High-Performance LLM Training Engineer

NVIDIA Corporation • Santa Clara (CA)

Hybride
USD 184 000 - 357 000
Equity
Benefits package
Hybrid work option
Senior Math Libraries Engineer - Sparsity in AI
Senior Math Libraries Engineer - Sparsity in AI

NVIDIA Corporation • Santa Clara (CA)

Sur place
USD 184 000 - 357 000
Equity
Benefits
Senior GPU Linear Algebra Kernel Engineer
Senior GPU Linear Algebra Kernel Engineer

NVIDIA Corporation • California

Sur place
USD 184 000 - 357 000