AI Cloud Platform Engineer — Scale-Out Systems, Equity

NVIDIA Corporation (old); Santa Clara (CA); On-site; USD 152,000 - 242,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation is seeking a motivated AI/ML Engineer for the Cloud Functions team in Santa Clara, focusing on a serverless deployment platform for AI workloads. You will translate user challenges into product requirements, implement key features, and ensure scalable, reliable performance across GPU-backed clusters.

You will collaborate with multiple teams, mentor others, and help shape the roadmap for AI at scale with cutting-edge frameworks and inference software.

Qualifications

• Masters/PhD or equivalent experience in Computer Science, Artificial Intelligence, Applied Math, or related field.
• At least 2 years work experience with Python, Rust, Golang, Linux or Bash.
• Experience in Deep Learning and Machine Learning; expertise in using AI/DL frameworks and inferencing software such as SGLang, vLLM, TensorRT-LLM, or Dynamo.
• Knowledge of CPU and GPU architecture.
• Excellent interpersonal skills including ability to explain sophisticated technical topics to non-experts.
• Experience in the design, implementation, and release of AI/ML products to market.
• A flexible technologist familiar with all aspects of the software development lifecycle.

Responsibilities

• Becoming a trusted subject matter expert by understanding user challenges and constraints.
• Translate this into product requirements and solutions, accelerating delivery of AI models and inference hosted on the NVCF platform.
• Leading implementation of key features.
• Conducting user-acceptance testing, load testing and performance evaluations.
• Emphasis on customer experience, performance optimization and platform reliability.
• Mentoring and embedding with other engineering teams building products on top of our platform on best practices for AI/ML workloads at scale with excellent performance, including ML reliability engineering at scale.
• Producing reference architectures to guide customer use cases, applying the newest NVCF product features with the latest AI technologies.
• Shepherding customer issues to resolution and providing timely warning of issues and risks.
• Evaluating new and innovative technologies and tooling as the AI-at-scale landscape evolves to ensure we have a competitive product and forward-looking roadmap.

Skills

Python

Rust

Golang

Linux

AI/ML

Communication

Education

Master's degree in CS/AI

Tools

SGLang

vLLM

TensorRT-LLM

Dynamo

Job description

NVIDIA Corporation is seeking a motivated AI/ML Engineer for the Cloud Functions team in Santa Clara, focusing on a serverless deployment platform for AI workloads. You will translate user challenges into product requirements, implement key features, and ensure scalable, reliable performance across GPU-backed clusters.

You will collaborate with multiple teams, mentor others, and help shape the roadmap for AI at scale with cutting-edge frameworks and inference software.