Senior LLM Inference Algorithms Engineer — Equity Options

NVIDIA; California (MO); On-site; USD 272,000 - 431,250; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking outstanding engineers to help shape the future of LLM inference across agentic and reasoning use cases. We push the boundaries of what's possible with large language models and design scalable, datacenter-scale systems.

You will research and develop inference algorithms, profile workloads to reduce latency and increase throughput, and collaborate with diverse NVIDIA teams and partners to deliver efficient, cutting-edge solutions.

Qualifications

• BS, MS, or PhD in Computer Science, Electrical Engineering, Computer Engineering, or related field (or equivalent experience).
• 15+ years of experience in deep learning and deep learning systems design.
• Proficiency in Python and C++ programming.
• Strong understanding of computer architecture and GPU/parallel datacenter computing fundamentals.
• Proven interest in analyzing, modeling, and tuning application performance.

Responsibilities

• Research and Development: Explore and incorporate contemporary research on generative AI, agents, and inference systems into the NVIDIA LLM software stack.
• Workload Analysis and Optimization: Profile and optimize agentic LLM workloads to reduce latency and increase throughput while maintaining fidelity.
• System Design and Implementation: Design scalable systems to accelerate agentic workflows and handle datacenter-scale use cases.
• Collaboration and Communication: Advise iterations of software, hardware, and systems by engaging with teams at NVIDIA and external partners.

Skills

Python

C++

Deep learning

Education

BS/MS/PhD in Computer Science, Electrical Engineering, Computer Engineering

Tools

CUDA

OpenCL

Job description

NVIDIA is seeking outstanding engineers to help shape the future of LLM inference across agentic and reasoning use cases. We push the boundaries of what's possible with large language models and design scalable, datacenter-scale systems.

You will research and develop inference algorithms, profile workloads to reduce latency and increase throughput, and collaborate with diverse NVIDIA teams and partners to deliver efficient, cutting-edge solutions.