Senior Inference Engineer: GPU Kernel Optimization & Equity

NVIDIA Corporation; United States; On-site; USD 184,000 - 288,000; Full time

Job summary

NVIDIA Corporation invites a Sr. Inference Engineer to advance GPU kernel optimization for LLM inference.

You will drive kernel microbenchmarking, connect performance data to model-level serving economics, and guide agentic optimization across the kernel ecosystem in collaboration with compiler, hardware, and framework teams. Role requires senior expertise in Python/C++, model frameworks, and GPU profiling, with a track record of delivering performance gains on real silicon.

Qualifications

• Master's or PhD in Computer Science, Computer Engineering, or a related field, or equivalent experience.
• 6+ years of relevant industry experience.
• Experience building or directing agentic AI systems - code generation, automated optimization, or multi-step reasoning workflows.
• Strong Python and C++ skills with proven software engineering fundamentals.
• Hands-on GPU profiling with CUPTI, NSYS, and NCU; ability to attribute bottlenecks across kernel execution, compiler decisions, and runtime scheduling.
• Direct experience with LLM inference frameworks such as TRT-LLM, SGLang, or vLLM and understanding of kernel-driven throughput and latency.
• Working knowledge of GPU kernel optimization - CUDA, CUTLASS, Triton or equivalent; ability to read PTX or SASS output.

Responsibilities

• Drive GPU kernel microbenchmarking across full configuration spaces for production LLM deployments.
• Conduct end-to-end model performance analysis to inform optimization policies for production inference deployments.
• Apply AI-driven analysis to diagnose performance gaps and validate findings with silicon measurements.
• Collaborate with compiler, hardware, kernel, and framework teams to surface bottlenecks and deliver production-grade improvements.

Skills

Python

C++

Agentic AI systems

GPU profiling

Kernel optimization

Software engineering

LLM inference frameworks

Education

Master's or PhD in CS/CE or related field

Tools

CUPTI

NSYS

NCU

CUDA

CUTLASS

Triton

PTX/SASS

Job description

NVIDIA Corporation invites a Sr. Inference Engineer to advance GPU kernel optimization for LLM inference.

You will drive kernel microbenchmarking, connect performance data to model-level serving economics, and guide agentic optimization across the kernel ecosystem in collaboration with compiler, hardware, and framework teams. Role requires senior expertise in Python/C++, model frameworks, and GPU profiling, with a track record of delivering performance gains on real silicon.