Senior CUDA & Deep Learning Systems Engineer

NVIDIA Corporation; Santa Clara (CA); On-site; USD 224,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation in Santa Clara, CA is seeking an experienced software professional to advance pioneering initiatives at the intersection of CUDA and Deep Learning Systems. You will tackle complex optimization across DL workloads, high-performance kernels, and distributed AI systems, delivering scalable performance from a single GPU to large clusters.

Join a research-oriented team that collaborates with AI researchers and HW/SW architects to push the boundaries of accelerator architectures,

Qualifications

• BS/MS/PhD in Computer Science, Computer Engineering, Electrical Engineering or related field (or equivalent experience).
• 8+ years of relevant industry or academic experience after degree.
• Strong proficiency in C++ and Python programming.
• Solid background in Deep Learning with focus on transformers.
• Strong understanding of distributed computing, multi-node scaling, and cluster-scale performance.
• Experience in systems programming, computer architecture and low-level optimization.
• Hands-on CUDA programming, kernel optimization and workload profiling; experience with Gen AI models.

Responsibilities

• Explore novel system optimizations for deep learning models at the intersection of CUDA and DL frameworks.
• Architect and optimize distributed systems that scale from a node to large clusters.
• Design and optimize custom high-performance CUDA kernels for emerging neural architectures.
• Analyze hardware-software interactions to resolve training and inference bottlenecks.
• Collaborate with AI researchers, HW/SW architects, kernel authors and CUDA experts to improve utilization and memory bandwidth.
• Develop exploratory tools and runtimes to profile and accelerate new DL paradigms.
• Write clean, maintainable code and enable prototype transitions to open-source or internal tools.

Skills

C++

Python

Deep Learning

CUDA

Distributed systems

Kernel optimization

Performance profiling

Education

BS/MS/PhD in CS/CE or related field

Tools

CUDA

NCCL

MPI

UCX

Triton

XLA

torch.compile

Job description

NVIDIA Corporation in Santa Clara, CA is seeking an experienced software professional to advance pioneering initiatives at the intersection of CUDA and Deep Learning Systems. You will tackle complex optimization across DL workloads, high-performance kernels, and distributed AI systems, delivering scalable performance from a single GPU to large clusters.

Join a research-oriented team that collaborates with AI researchers and HW/SW architects to push the boundaries of accelerator architectures,