Senior AI Inference Systems Engineer: GPU-Optimized, Cloud

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 184,000 - 356,500; Full time

Benefits offered by this job

Equity opportunities

Comprehensive benefits package

Job summary

NVIDIA Gruppe is looking for skilled software engineers to develop AI inference systems that operate with high efficiency. The role involves architecting high-performance inference frameworks and optimizing GPU processes. Ideal candidates should have extensive programming experience and strong educational backgrounds in computer science or engineering.

Compensation ranges from 184,000 USD to 356,500 USD based on experience. Apply before May 2, 2026.

Qualifications

• 7+ years of experience in software engineering or equivalent.
• Strong programming skills in Python and C/C++.
• Experience with Go or Rust is a plus.

Responsibilities

• Optimize the inference framework using advanced techniques.
• Benchmark GPU kernels using optimization techniques.
• Define and build inference benchmarking tools.

Skills

Python

C/C++

GPU programming

Performance engineering in ML frameworks

Parallel programming

Education

Bachelor’s degree in Computer Science or equivalent

Master’s degree in Computer Science/Engineering

PhD in ML Systems or related field

Tools

Docker

Kubernetes

CUDA

Nsight Systems/Compute

Job description

NVIDIA Gruppe is looking for skilled software engineers to develop AI inference systems that operate with high efficiency. The role involves architecting high-performance inference frameworks and optimizing GPU processes. Ideal candidates should have extensive programming experience and strong educational backgrounds in computer science or engineering.

Compensation ranges from 184,000 USD to 356,500 USD based on experience. Apply before May 2, 2026.