Engineering Manager: Deep Learning Inference & GPU

Jobtailor; California (MO); On-site; USD 180,000 - 260,000; Full time

Job summary

NVIDIA is seeking a senior engineering leader to guide an elite team focused on deep learning inference and GPU-accelerated software. You will shape strategy, drive execution of inference frameworks for Client AI, and collaborate with compiler, libraries, and research teams to optimize pipelines across accelerators.

You will mentor engineers, champion CUDA/Triton/CUTLASS adoption, and push performance optimization for large-scale models. Expect a roles-focused, impact-driven environment.

Qualifications

• MS/PhD or equivalent in CS/EE or related field.
• 6+ years of software development experience.
• 3+ years in technical leadership or engineering management.
• Strong background in C/C++ software design and development.
• Proficiency in Python is a plus.
• Hands-on GPU programming with CUDA/Triton/CUTLASS.
• Experience with performance optimization in production.
• Leading teams with Agile or collaborative practices.
• Open-source contributions to DL or inference frameworks advantageous.

Responsibilities

• Lead, mentor, and scale a high-performing engineering team focused on deep learning inference and GPU-accelerated software.
• Drive strategy, roadmap, and execution of inference frameworks engineering, focusing on Client AI.
• Partner with compiler, libraries, and research teams to deliver optimized inference pipelines across NVIDIA accelerators.
• Oversee performance tuning, profiling, and optimization of large-scale models for LLM and multimodal AI.
• Guide engineers in adopting CUDA, Triton, and multi-GPU communication technologies.
• Represent the team in roadmap and planning discussions and foster technical excellence.

Skills

Technical Leadership

Deep Learning Model Optimization

CUDA Programming

Performance Tuning

Agile Software Development

Team Leadership

Education

MS/PhD in CS/EE or related field

Tools

CUDA

Triton

CUTLASS

NIXL

NCCL

NVSHMEM

Job description

NVIDIA is seeking a senior engineering leader to guide an elite team focused on deep learning inference and GPU-accelerated software. You will shape strategy, drive execution of inference frameworks for Client AI, and collaborate with compiler, libraries, and research teams to optimize pipelines across accelerators.

You will mentor engineers, champion CUDA/Triton/CUTLASS adoption, and push performance optimization for large-scale models. Expect a roles-focused, impact-driven environment.