Senior Dynamo-Triton AI Inference Engineer (Remote)

NVIDIA Corporation; Santa Clara (CA); Hybrid; USD 224,000 - 357,000; Full time

Benefits offered by this job

Equity

Comprehensive benefits

Hybrid work model

Job summary

NVIDIA Corporation seeks a Senior System Software Engineer to advance Dynamo-Triton Inferencing. You will develop and optimize GPU-accelerated AI inference software, contribute to features, and align Triton with Dynamo to deliver a unified high-performance platform for LLM and non-LLM workloads.

You will join an agile team, design robust production systems, and participate in open source collaboration while shaping next-gen inference tech and performance improvements.

Qualifications

• MS or PhD in Computer Science or relevant field (or equivalent experience).
• 12+ years of professional experience working on deep learning software.
• Excellent Rust & C++ skills, familiarity with Python, and strong programming & software design skills including debugging, performance analysis, and test design.
• Experience with high-scale distributed systems and ML systems.
• Strong communication skills and ability to work in a fast-paced, agile team environment.

Responsibilities

• Develop world-class GPU-accelerated AI inference serving software.
• Contribute to feature development and drive broad customer adoption.
• Drive the convergence of the Triton Inference Server and NVIDIA Dynamo stacks to establish a unified, high-performance inference platform.
• Be an active member of the open source deep learning software engineering community.
• Balance objectives like production deployment, throughput/latency optimization, and advancing next-gen inference technologies.

Skills

Rust

C++

Python

Performance analysis

Debugging

Test design

Distributed systems

ML systems

Communication

Education

MS or PhD in Computer Science

Tools

TensorRT

PyTorch

ONNX

OpenVINO

vLLM

TRT-LLM

GitHub

Job description

NVIDIA Corporation seeks a Senior System Software Engineer to advance Dynamo-Triton Inferencing. You will develop and optimize GPU-accelerated AI inference software, contribute to features, and align Triton with Dynamo to deliver a unified high-performance platform for LLM and non-LLM workloads.

You will join an agile team, design robust production systems, and participate in open source collaboration while shaping next-gen inference tech and performance improvements.