Senior TensorRT Edge-LLM Inference Engineer

NVIDIA; California (MO); On-site; USD 152,000 - 241,500; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a software engineer to join its TensorRT Edge-LLM team, focusing on developing a state-of-the-art inference framework for large language models. The role requires a deep understanding of transformer models, modern C++ programming skills, and experience with LLM frameworks. The position offers competitive salary ranges between $152,000 and $287,500, equity, and benefits. NVIDIA values diversity and provides an equal-opportunity workplace.

Qualifications

• 4+ years of relevant software development experience.
• Familiarity with popular LLM frameworks and libraries.
• A track record of strong software design and execution.

Responsibilities

• Develop a state-of-the-art inference framework in modern C++.
• Design and implement optimizations for transformer-based models.
• Benchmark and optimize inference performance across environments.

Skills

Deep understanding of transformer models

Modern C++ programming (C++11/14/17)

Inference optimization techniques

Collaboration across fields

Education

BS, MS, PhD in Computer Science or related field

Tools

TensorRT

CUDA

Job description

NVIDIA is seeking a software engineer to join its TensorRT Edge-LLM team, focusing on developing a state-of-the-art inference framework for large language models. The role requires a deep understanding of transformer models, modern C++ programming skills, and experience with LLM frameworks. The position offers competitive salary ranges between $152,000 and $287,500, equity, and benefits. NVIDIA values diversity and provides an equal-opportunity workplace.