Senior AI Systems Engineer – Edge GPU & Local Inference

NVIDIA; Santa Clara (CA); On-site; USD 152,000 - 287,500; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA seeks a Senior Systems Software Engineer to tackle client-side AI challenges on Windows and Linux PCs with limited resources. You will collaborate with internal teams to align AI strategies for RTX and DGX ecosystems, while optimizing AI models, data pipelines, and inference runtimes for performance on next-generation GPUs.

The role requires deep C++ expertise, 5+ years in AI inference, and experience with ONNX RT, PyTorch, TensorRT, llama.cpp, and vLLM.

Qualifications

• Bachelor's, Master's, or PhD in Computer Science, Software Engineering, Mathematics, or related field (or equivalent experience).
• Excellent C++ programming and debugging skills with strong data structures/algorithms knowledge.
• 5+ years of experience with AI inferencing pipelines using ML/DL frameworks (ONNX RT, PyTorch, TensorRT, llama.cpp, vLLM).
• Strong analytical and problem-solving abilities; ability to multitask in a dynamic environment.
• Outstanding written and oral communication skills enabling collaboration with management and engineering teams.

Responsibilities

• Partner with NVIDIA teams to align strategies for AI on RTX and DGX PCs.
• Collaborate with industry partners to advance AI across graphics, browsers, edge devices.
• Optimize performance on GPU architectures by end-to-end analysis of AI models and inference runtime features.
• Identify and implement compute/memory optimizations (quantization, distillation, pruning) for large models for edge devices.

Skills

C++ programming

Data structures & algorithms

AI inferencing pipelines

ONNX RT

PyTorch

TensorRT

Education

Bachelor's degree in CS/SE

Tools

CUDA

DirectX

Vulkan

llama.cpp

vLLM

Job description

NVIDIA seeks a Senior Systems Software Engineer to tackle client-side AI challenges on Windows and Linux PCs with limited resources. You will collaborate with internal teams to align AI strategies for RTX and DGX ecosystems, while optimizing AI models, data pipelines, and inference runtimes for performance on next-generation GPUs.

The role requires deep C++ expertise, 5+ years in AI inference, and experience with ONNX RT, PyTorch, TensorRT, llama.cpp, and vLLM.