Senior DL Software Engineer - Inference & Model Optimization (Equity)

2100 NVIDIA USA; Santa Clara (CA); On-site; USD 184,000 - 356,500; Full time

Benefits offered by this job

Equity

Job summary

NVIDIA in Santa Clara, CA, is seeking a Senior Deep Learning Software Engineer to scale our automated inference and deployment solution within the Algorithmic Model Optimization Team. You will work across the ML stack, from PyTorch and HuggingFace to high‑performance CUDA kernels and the TRT Model Optimizer, building a modular, scalable platform.

Applicants should have a Masters or PhD (or equivalent), 5+ years in deep learning, excellent Python and PyTorch skills, and strong software design and

Qualifications

• Masters, PhD, or equivalent experience in Computer Science, AI, Applied Math, or related field.
• 5+ years of relevant work or research experience in Deep Learning.
• Excellent software design skills, including debugging, performance analysis, and test design.
• Strong proficiency in Python, PyTorch, and related ML tools (e.g. HuggingFace).
• Strong algorithms and programming fundamentals.
• Good written and verbal communication skills and the ability to work independently and collaboratively in a fast-paced environment.

Responsibilities

• Train, develop, and deploy state‑of‑the generative AI models like LLMs and diffusion models using NVIDIA's AI software stack.
• Leverage Torch 2.0 ecosystem to analyze and extract standardized model graphs for automated deployment.
• Develop high-performance optimization techniques for inference (e.g., tensor parallelism, kv-caching).
• Collaborate with teams across NVIDIA to implement performant kernel code in our deployment solution.
• Analyze and profile GPU kernel-level performance to identify optimization opportunities.
• Innovate on inference performance to maintain leadership with TRT, TRT‑LLM, and TRT Model Optimizer.
• Architect and design a modular, scalable platform with broad model support and optimization techniques.

Skills

Python

PyTorch

HuggingFace

Algorithms

Software design

Education

Masters or PhD in CS/AI/Applied Math

Tools

CUDA

TensorRT

Triton

Cutlass

Job description

NVIDIA in Santa Clara, CA, is seeking a Senior Deep Learning Software Engineer to scale our automated inference and deployment solution within the Algorithmic Model Optimization Team. You will work across the ML stack, from PyTorch and HuggingFace to high‑performance CUDA kernels and the TRT Model Optimizer, building a modular, scalable platform.

Applicants should have a Masters or PhD (or equivalent), 5+ years in deep learning, excellent Python and PyTorch skills, and strong software design and