Senior System Software Engineer - GPU AI Inference Equity

NVIDIA; United States; On-site; USD 152,000 - 241,500; Full time

Benefits offered by this job

Eligible for equity

Additional benefits

Job summary

A leading technology firm is seeking a Senior System Software Engineer to develop GPU-accelerated AI inference software and contribute to the Triton Inference Server. The role requires 5+ years of experience in deep learning software, strong skills in Rust and C++, and familiarity with distributed systems. You will work in a fast-paced environment, driving customer adoption and building robust, production-ready software. Compensation ranges from $152,000 to $241,500, depending on experience and location.

Qualifications

• 5+ years of professional experience working on deep learning software.
• Experience with high-scale distributed systems and ML systems.
• Strong programming and software design skills including debugging, performance analysis, and test design.

Responsibilities

• Develop world‑class GPU‑accelerated AI inference serving software.
• Contribute to feature development and drive broad customer adoption.
• Drive the convergence of the Triton Inference Server and NVIDIA Dynamo stacks.

Skills

Rust

C++

Python

Distributed systems programming

Communication skills

Education

MS or PhD in Computer Science or relevant field

Tools

TensorRT

PyTorch

ONNX

OpenVINO

vLLM

TRT-LLM

Job description

A leading technology firm is seeking a Senior System Software Engineer to develop GPU-accelerated AI inference software and contribute to the Triton Inference Server. The role requires 5+ years of experience in deep learning software, strong skills in Rust and C++, and familiarity with distributed systems. You will work in a fast-paced environment, driving customer adoption and building robust, production-ready software. Compensation ranges from $152,000 to $241,500, depending on experience and location.