Senior Software Engineer, GPU Kernel Perf & CUTLASS (Equity)

NVIDIA

United States

On-site

USD 152,000 - 288,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity compensation
Benefits

Job summary

NVIDIA Corporation in the United States is seeking a Deep Learning performance engineer to benchmark state-of-the-art models, identify fusion opportunities, and push CUTLASS kernel performance on GPUs.

You will collaborate across teams, develop tooling for automated benchmarking, and contribute to performance models, with equity and benefits as part of the compensation package. This role targets cutting-edge DL workloads and requires strong Python/C++ skills and GPU know-how.

Qualifications

  • Masters or PhD degree in Computer Science, Computer Engineering, or related field (or equivalent experience).
  • 3+ years of relevant industry experience.
  • Strong programming skills in Python and C++.
  • Experience in software performance analysis and optimization.
  • Deep understanding of computer architecture and familiarity with GPUs or similar parallel processing architectures.

Responsibilities

  • Benchmark the performance of state-of-the-art deep learning models' inference and training passes to identify key GPU kernel and fusion opportunities.
  • Identify gaps between theoretical and realized performance, and suggest software improvements or model adjustments to resolve them.
  • Develop tooling to automate the benchmarking, analysis, and performance optimization loop to push the limit of CUTLASS kernel performance within DL networks.
  • Be the authoritative resource on kernel performance in the team and engage with teams across NVIDIA including GPU architecture, DL frameworks, and QA as the performance representative for the CUTLASS team.

Skills

Python
C++
Performance analysis
GPU architectures
3+ years experience

Education

Masters or PhD in CS/CE or related field

Job description

NVIDIA Corporation in the United States is seeking a Deep Learning performance engineer to benchmark state-of-the-art models, identify fusion opportunities, and push CUTLASS kernel performance on GPUs.

You will collaborate across teams, develop tooling for automated benchmarking, and contribute to performance models, with equity and benefits as part of the compensation package. This role targets cutting-edge DL workloads and requires strong Python/C++ skills and GPU know-how.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, CUTLASS Performance - On-site Equity
Senior Software Engineer, CUTLASS Performance - On-site Equity

Talemexa • Hillsboro (OR)

On-site
USD 152,000 - 288,000
CUTLASS GPU Performance Engineer – Kernel Benchmarking
CUTLASS GPU Performance Engineer – Kernel Benchmarking

NVIDIA Corporation • Redmond (WA)

On-site
USD 152,000 - 241,500
CUTLASS GPU Performance Engineer – Kernel Benchmarking
CUTLASS GPU Performance Engineer – Kernel Benchmarking

NVIDIA Corporation • Hillsboro (OR)

On-site
USD 152,000 - 287,500
Senior Software Engineer, CUTLASS Performance & Benchmarks
Senior Software Engineer, CUTLASS Performance & Benchmarks

NVIDIA Corporation • Austin (TX)

On-site
USD 152,000 - 241,500
Equity
Benefits
CUTLASS GPU Performance Engineer – Kernel Benchmarking
CUTLASS GPU Performance Engineer – Kernel Benchmarking

NVIDIA Corporation • Durham (NC)

On-site
USD 152,000 - 241,500
Senior Software Engineer, CUTLASS Performance
Senior Software Engineer, CUTLASS Performance

NVIDIA • United States

On-site
USD 152,000 - 288,000
Equity compensation
Benefits
Senior Software Engineer, CUTLASS Performance
Senior Software Engineer, CUTLASS Performance

NVIDIA Corporation • Durham (NC)

On-site
USD 152,000 - 241,500
Senior Software Engineer, CUTLASS Performance
Senior Software Engineer, CUTLASS Performance

NVIDIA Corporation • Redmond (WA)

On-site
USD 152,000 - 241,500
Senior Software Engineer, CUTLASS Performance
Senior Software Engineer, CUTLASS Performance

NVIDIA Corporation • Hillsboro (OR)

On-site
USD 152,000 - 287,500
Senior Software Engineer, CUTLASS Performance
Senior Software Engineer, CUTLASS Performance

Talemexa • Hillsboro (OR)

On-site
USD 152,000 - 288,000