Senior AI Inference Systems Engineer Dynamo-Triton Equity

NVIDIA; Santa Clara (CA); On-site; USD 224,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior System Software Engineer to advance Dynamo-Triton Inference Server on a fast-paced, GPU-accelerated AI platform. You will develop high-performance software for production server and cloud environments, driving feature parity for LLM and non-LLM workloads.

You will contribute to open source communities, optimize throughput and latency, and work with a skilled team on distributed ML systems. Equity and comprehensive benefits are included.

Qualifications

• MS or PhD in Computer Science or a relevant field (or equivalent experience).
• 12+ years of professional experience in deep learning software.
• Excellent Rust & C++ skills, familiarity with Python, strong design skills.

Responsibilities

• Develop world-class GPU-accelerated AI inference serving software.
• Contribute to feature development and drive customer adoption.
• Converge Triton Inference Server and NVIDIA Dynamo stacks for a unified platform.
• Engage with the open source deep learning software community.
• Balance production readiness with performance and latency optimization.

Skills

Rust

C++

Python

Performance analysis

Debugging

Test design

Distributed systems

ML systems

Communication skills

Education

MS/PhD in Computer Science

Tools

GitHub

Bug tracking

OSS licensing

Job description

NVIDIA is seeking a Senior System Software Engineer to advance Dynamo-Triton Inference Server on a fast-paced, GPU-accelerated AI platform. You will develop high-performance software for production server and cloud environments, driving feature parity for LLM and non-LLM workloads.

You will contribute to open source communities, optimize throughput and latency, and work with a skilled team on distributed ML systems. Equity and comprehensive benefits are included.