AI & Cloud Systems Engineer — Kubernetes & Inference

NVIDIA; Santa Clara (CA); On-site; USD 108,000 - 178,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA in Silicon Valley is seeking a Systems Software Engineer focused on AI and Cloud, to work on cloud-native architectures and advanced AI models. You will engage with NVIDIA frameworks, contribute to tutorials, and deliver technical demos across teams.

The role emphasizes collaboration with product, marketing, hardware, and QA, and requires strong Python/JavaScript skills, C++ familiarity, and API design know-how. Competitive base salary with equity continues to be offered.

Qualifications

• Bachelor’s or Master’s in Software Engineering, CS, CE, EE or equivalent experience.
• Proficiency in Python and JavaScript with strong data structures, algorithms and design principles.
• Basic familiarity with C++ for HPC environments.
• Experience building cloud-native systems optimized for Kubernetes deployment and inference frameworks.
• Solid understanding of API design for scalable production inference systems.

Responsibilities

• Evaluate cloud-native, full-stack apps using microservices to power AI use cases with NVIDIA frameworks and tools.
• Design and implement agentic workflows using RAG and modern AI models.
• Assess user experiences and technical performance, producing reports with improvement recommendations.
• Collaborate with product, marketing, hardware, software eng, and QA to enhance NVIDIA products.
• Create developer content, tutorials, and code samples to demonstrate latest features.
• Produce whitepapers, product briefs, and demos for industry conferences.

Skills

Python

JavaScript

C++ basics

Kubernetes deployment

API design

Data structures

Algorithms

Software design

Education

Bachelor's or Master's in Software Engineering / CS / CE / EE

Tools

NVIDIA Triton Inference Server

vLLM

TensorRT

Kubernetes

Job description

NVIDIA in Silicon Valley is seeking a Systems Software Engineer focused on AI and Cloud, to work on cloud-native architectures and advanced AI models. You will engage with NVIDIA frameworks, contribute to tutorials, and deliver technical demos across teams.

The role emphasizes collaboration with product, marketing, hardware, and QA, and requires strong Python/JavaScript skills, C++ familiarity, and API design know-how. Competitive base salary with equity continues to be offered.