Engineering Manager, GPU-Accelerated LLM Inference

NVIDIA; California (MO); On-site; USD 184,000 - 356,500; Full time

Job summary

NVIDIA is looking for a highly skilled Engineering Manager in California, MO, to lead a team focusing on AI inference software technologies. This role involves overseeing specialized kernel development and optimizing runtime for deep learning models. Candidates should have an MS or PhD in a related field and substantial software engineering experience. Compensation offers a competitive salary range between $184,000 and $356,500, along with equity and benefits. Join us if you're a creative self-starter passionate about technology.

Qualifications

• 7+ years of software engineering experience, including 3+ years of technical leadership experience.
• Proven ability to lead high-performing engineering teams across distributed groups.
• Strong background in delivering production-quality software libraries.

Responsibilities

• Lead team in specialized kernel development and runtime optimizations.
• Drive design and delivery of production inference software.
• Integrate cutting-edge technologies and enhance developer experience.

Skills

C++

Python

Technical leadership

Software design

Large language models

Vision language models

Education

MS or PhD in Computer Science or related field

Job description

NVIDIA is looking for a highly skilled Engineering Manager in California, MO, to lead a team focusing on AI inference software technologies. This role involves overseeing specialized kernel development and optimizing runtime for deep learning models. Candidates should have an MS or PhD in a related field and substantial software engineering experience. Compensation offers a competitive salary range between $184,000 and $356,500, along with equity and benefits. Join us if you're a creative self-starter passionate about technology.