Senior AI Infra Engineer — DGX Cloud (Equity)

NVIDIA Corporation; Santa Clara (CA); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation in Santa Clara seeks an AI infrastructure software engineer to design, build, and maintain scalable AI infrastructure for pre-training, post-training, and inference. You will work on APIs, resiliency stacks, and reliability metrics with a focus on efficiency and availability.

The role emphasizes solving complex problems, collaborating across teams, and contributing to a blameless, iterative culture. Equity and benefits are provided along with a base salary tied to level.

Qualifications

• Minimum 8+ years of experience developing software infrastructure for large scale AI systems.
• Bachelor's degree or higher in Computer Science or a related technical field.
• Strong debugging skills and ability to triage AI applications from software to hardware.
• Experience with observability platforms for monitoring and logging.

Responsibilities

• Develop infrastructure software and tools for large-scale pre-training, post-training, and inference.
• Develop and optimize tools and libraries to improve infrastructure efficiency and resiliency.
• Co-design and implement APIs for integration with NVIDIA's resiliency stacks.
• Enhance infrastructure and products underpinning NVIDIA's AI platforms.
• Define meaningful reliability metrics to track and improve systems.

Skills

Python

C/C++

Scripting languages

Distributed systems

Observability

Debugging

CI

Communication

Education

Bachelor's degree in Computer Science or related field

Tools

ELK

Prometheus

Loki

NCCL

IB Verbs

ucx

Job description

NVIDIA Corporation in Santa Clara seeks an AI infrastructure software engineer to design, build, and maintain scalable AI infrastructure for pre-training, post-training, and inference. You will work on APIs, resiliency stacks, and reliability metrics with a focus on efficiency and availability.

The role emphasizes solving complex problems, collaborating across teams, and contributing to a blameless, iterative culture. Equity and benefits are provided along with a base salary tied to level.