Principal AI/ML Infra Engineer — GPU Clusters & HPC

NVIDIA; Santa Clara (CA); In loco; USD 272.000 - 431.000; Tempo pieno

Vantaggi offerti da questo lavoro

Equity

Benefits package

Descrizione del lavoro

NVIDIA seeks a Principal AI and ML Infra Software Engineer for the GPU Clusters within the Hardware Infrastructure team in Santa Clara. You will partner with AI/ML researchers to translate needs into scalable infra improvements and lead long-term initiatives to boost researcher efficiency.

By shaping distributed training operations, you will work with data engineers and DevOps to optimize performance, availability, and resource utilization.

Competenze

• BS or similar background in Computer Science or related area (or equivalent experience).
• 15+ years of demonstrated expertise in AI/ML and HPC tasks and systems.
• Hands-on experience with HPC-grade infrastructure and accelerated computing (GPU, custom silicon).
• Experience with storage, scheduling/orchestration, high-speed networking, and containers.
• Capability in supervising distributed training operations using PyTorch (DDP, FSDP), NeMo, or JAX.
• Proficiency in Python, Go, Bash; familiarity with cloud platforms (AWS, GCP, Azure).
• Commitment to ongoing learning and collaboration across diverse teams.

Mansioni

• Engage with AI/ML research teams to discern infrastructure needs and convert insights into improvements.
• Identify research bottlenecks and drive long-term initiatives and roadmaps.
• Monitor and optimize infrastructure for high availability, scalability, and efficiency.
• Help define measures of AI researcher efficiency aligned with measurable results.
• Collaborate with researchers, data engineers, and DevOps to build a cohesive AI/ML infra ecosystem.
• Stay up-to-date with AI/ML tech and advocate for its integration.

Conoscenze

Python

PyTorch

Distributed training

Go

Bash

NeMo

JAX

Cloud platforms

Communication

Collaboration

Formazione

Bachelor's degree in Computer Science or related field

Strumenti

Slurm

Kubernetes

LSF

Docker

Enroot

Infiniband

RoCE

GPFS

BeeGFS

Lustre

Descrizione del lavoro

NVIDIA seeks a Principal AI and ML Infra Software Engineer for the GPU Clusters within the Hardware Infrastructure team in Santa Clara. You will partner with AI/ML researchers to translate needs into scalable infra improvements and lead long-term initiatives to boost researcher efficiency.

By shaping distributed training operations, you will work with data engineers and DevOps to optimize performance, availability, and resource utilization.