AI & Cloud Systems Engineer: Kubernetes, LLMs & RAG

NVIDIA; Santa Clara (CA); On-site; USD 108,000 - 178,000; Full time

Benefits offered by this job

Equity

Job summary

NVIDIA seeks a Systems Software Engineer - AI and Cloud in Silicon Valley to join a team delivering cloud-native AI solutions. You’ll work across AI models, frameworks, and microservices to build scalable inference systems and developer content.

You will collaborate with cross-functional teams, optimize performance on Kubernetes, and contribute to whitepapers and product demos at major conferences. This role emphasizes hands-on engineering with modern AI tooling.

Qualifications

• Bachelor’s or Master’s in Software Engineering, CS, CE, Electrical Eng or related field (or equivalent).
• Proficiency in Python and JavaScript with solid data structures, algorithms, and design principles.
• Basic familiarity with C++ in high-performance computing environments.
• Experience in cloud-native systems optimized for Kubernetes deployment and inference frameworks like vLLM and Triton.
• Solid understanding of API design for scalable, production-ready inference systems.

Responsibilities

• Evaluate cloud-native, full-stack applications using microservices to power AI use cases with NVIDIA frameworks and SDKs.
• Design and implement agentic workflows with RAG and modern AI models.
• Evaluate UX and performance of AI solutions and report findings to executives and engineering management.
• Collaborate with product, marketing, hardware, software engineering, and QA teams to improve NVIDIA products.
• Develop developer-focused content, tutorials, and code samples demonstrating NVIDIA tools and libraries.
• Write technical whitepapers and product briefs and present demos at industry conferences.

Skills

Python

JavaScript

C++

Cloud-native

Kubernetes

APIs design

LLMs

Education

Bachelor or Master in Software Engineering/CS/CE/EE

Tools

NVIDIA Triton Inference Server

vLLM

TensorRT

Job description

NVIDIA seeks a Systems Software Engineer - AI and Cloud in Silicon Valley to join a team delivering cloud-native AI solutions. You’ll work across AI models, frameworks, and microservices to build scalable inference systems and developer content.

You will collaborate with cross-functional teams, optimize performance on Kubernetes, and contribute to whitepapers and product demos at major conferences. This role emphasizes hands-on engineering with modern AI tooling.