Senior AI Inference System Engineer - Dynamo-Triton

NVIDIA; Washington; On-site; USD 224,000 - 357,000; Full time

Job summary

NVIDIA is seeking a Senior System Software Engineer to work on the Dynamo-Triton Inference Server. You will develop world-class GPU-accelerated AI inference serving software and drive feature development to meet broad customer needs.

You will help converge the Triton Inference Server with NVIDIA Dynamo to deliver a unified, high-performance platform for LLM and non-LLM workloads. You will engage with the open source community and design robust software for production server or cloud

Qualifications

• MS or PhD in Computer Science or relevant field (or equivalent experience).
• 12+ years of professional experience working on deep learning software.
• Excellent Rust & C++ skills, familiarity with Python, and strong programming & software design skills including debugging, performance analysis, and test design.

Responsibilities

• Develop world-class GPU-accelerated AI inference serving software.
• Contribute to feature development and drive broad customer adoption.
• Drive the convergence of the Triton Inference Server and NVIDIA Dynamo stacks to establish a unified, high-performance inference platform.

Skills

Rust

C++

Python

Education

Master's or PhD in Computer Science

Tools

TensorRT

PyTorch

ONNX

OpenVINO

vLLM

TRT-LLM

Job description

NVIDIA is seeking a Senior System Software Engineer to work on the Dynamo-Triton Inference Server. You will develop world-class GPU-accelerated AI inference serving software and drive feature development to meet broad customer needs.

You will help converge the Triton Inference Server with NVIDIA Dynamo to deliver a unified, high-performance platform for LLM and non-LLM workloads. You will engage with the open source community and design robust software for production server or cloud