Senior AI Infra Engineer — Scale Cloud AI Platforms

NVIDIA; United States; On-site; USD 184,000 - 357,000; Full time

Job summary

NVIDIA is seeking a senior AI Infrastructure Software Engineer to join the DGX Cloud Lepton Team in the United States. You will design, build, and maintain platform tooling for large-scale AI, LLM, and GenAI workloads, focusing on efficiency, resiliency, and scalability across production environments.

The role emphasizes debugging, performance optimization, and API co-design for resiliency stacks, with a strong culture of learning and blameless postmortems.

Qualifications

• Minimum of 8+ years of experience developing software infrastructure for large scale AI systems.
• Bachelor's degree or higher in Computer Science or a related technical field (or equivalent experience).
• Strong debugging skills and experience in analyzing and triaging AI applications from the application level to the hardware level.
• Proven track record in building and scaling large-scale distributed systems.
• Experience with AI training and inferencing and data infrastructure services.
• Familiarity with Kubernetes and operating large-scale observability platforms for monitoring and logging (e.g., ELK, Prometheus, Loki).
• Proficiency in programming languages such as Golang, Python, C/C++, and script languages.

Responsibilities

• Develop platform and tools for large-scale AI, LLM, and GenAI infrastructure.
• Develop and optimize tools to improve AI/ML workload efficiency and resiliency.
• Root cause and analyze and triage failures from the application level to the hardware level.
• Enhance infrastructure and products underpinning NVIDIA's AI platforms.
• Co-design and implement APIs for integration with NVIDIA's resiliency stacks on the platform.
• Define meaningful and actionable reliability metrics to track and improve system and service reliability.
• Demonstrate strong problem-solving and optimization capabilities.

Skills

Golang

Python

C/C++

Distributed systems

Debugging

Shell scripting

Education

Bachelor's degree in Computer Science

Tools

Kubernetes

ELK

Prometheus

Loki

Job description

NVIDIA is seeking a senior AI Infrastructure Software Engineer to join the DGX Cloud Lepton Team in the United States. You will design, build, and maintain platform tooling for large-scale AI, LLM, and GenAI workloads, focusing on efficiency, resiliency, and scalability across production environments.

The role emphasizes debugging, performance optimization, and API co-design for resiliency stacks, with a strong culture of learning and blameless postmortems.