Senior System Software Engineer — GPU AI Inference (Triton)

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 152,000 - 241,500; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Gruppe is seeking a Senior System Software Engineer in Santa Clara, California, to develop world-class GPU-accelerated AI inference serving software. This role involves contributing to feature development and optimizing software for deployment in production environments.

The ideal candidate will have a minimum of 5 years of experience in deep learning software, excellent Rust & C++ skills, and a strong understanding of distributed systems. The position offers a competitive base salary, equity, and benefits, with applications accepted until at least May 1, 2026.

Qualifications

• 5+ years of professional experience working on deep learning software.
• Strong communication skills and ability to work in a fast-paced, agile team environment.
• Experience with ML systems and distributed systems programming.

Responsibilities

• Develop GPU-accelerated AI inference serving software.
• Contribute to feature development and drive customer adoption.
• Drive convergence of Triton Inference Server and NVIDIA Dynamo stacks.

Skills

Rust

C++

Python

Deep learning software

High-scale distributed systems

Software design

Education

MS or PhD in Computer Science or relevant field

Tools

TensorRT

PyTorch

ONNX

OpenVINO

Job description

NVIDIA Gruppe is seeking a Senior System Software Engineer in Santa Clara, California, to develop world-class GPU-accelerated AI inference serving software. This role involves contributing to feature development and optimizing software for deployment in production environments.

The ideal candidate will have a minimum of 5 years of experience in deep learning software, excellent Rust & C++ skills, and a strong understanding of distributed systems. The position offers a competitive base salary, equity, and benefits, with applications accepted until at least May 1, 2026.