Senior AI Cloud Platform Engineer - Serverless & GPU

Nvidia Corporation in; Santa Clara (CA); On-site; USD 184,000 - 288,000; Full time

Job summary

NVIDIA is seeking a Senior Systems Software Engineer for the NV Cloud Functions (Finance) team to build and operate a serverless deployment platform for AI applications at scale. You will translate user challenges into requirements, lead feature implementations, and mentor other teams working on AI/ML workloads across GPU-enabled Kubernetes clusters.

The role emphasizes performance, reliability, and reference architectures, with equity and comprehensive benefits.

Qualifications

• Masters, PhD, or equivalent experience in Computer Science, Artificial Intelligence, Applied Math, or related field.
• At least 2 years work experience with Python, Rust, Golang, Linux or Bash.
• Experience in Deep Learning and Machine Learning; expertise in using AI/DL frameworks and inferencing software such as SGLang, vLLM, TensorRT-LLM, or Dynamo.
• Knowledge of CPU and GPU architecture.
• Excellent interpersonal skills including ability to explain sophisticated technical topics to non-experts.
• Experience in the design, implementation, and release of AI/ML products to market. A flexible technologist familiar with all aspects of the software development lifecycle.

Responsibilities

• Becoming a trusted subject matter expert by understanding user challenges and constraints. Translate this into product requirements and solutions, accelerating delivery of AI models and inference hosted on the NVCF platform.
• Leading implementation of key features. Conducting user-acceptance testing, load testing and performance evaluations. Emphasis on customer experience, performance optimization and platform reliability.
• Mentoring and embedding with other engineering teams building products on top of our platform on best practices for AI/ML workloads at scale with excellent performance, including ML reliability engineering at scale.
• Producing reference architectures to guide customer use cases, applying the newest NVCF product features with the latest AI technologies.
• Shepherding customer issues to resolution and providing timely warning of issues and risks.
• Evaluating new and innovative technologies and tooling as the AI-at-scale landscape evolves to ensure we have a competitive product and forward-looking roadmap.

Skills

Python

Rust

Golang

Linux/Bash

Deep Learning

ML frameworks

CPU/GPU architecture

Communication skills

SDLC

Education

Masters/PhD or equivalent experience

Job description

NVIDIA is seeking a Senior Systems Software Engineer for the NV Cloud Functions (Finance) team to build and operate a serverless deployment platform for AI applications at scale. You will translate user challenges into requirements, lead feature implementations, and mentor other teams working on AI/ML workloads across GPU-enabled Kubernetes clusters.

The role emphasizes performance, reliability, and reference architectures, with equity and comprehensive benefits.