Senior AI Infrastructure Engineer — Scale GPU Clusters

AI Breaking Wire; San Francisco (CA); On-site; USD 280,000 - 400,000; Full time

Benefits offered by this job

Equity

Medical, dental, and vision benefits

Unlimited PTO

Parental leave (flexible)

Learning stipend

Job summary

OpenAI is seeking a Senior Infrastructure Engineer to help build and scale the compute infrastructure powering state-of-the-art generative AI models in San Francisco. You will work with massive clusters of GPUs to optimize training and inference performance.

You will collaborate with research teams to remove bottlenecks, optimize networks and storage, and troubleshoot complex distributed systems across thousands of accelerators.

Qualifications

• 5+ years of experience in software engineering with a focus on large-scale distributed systems or ML infrastructure.
• Deep expertise in CUDA, NCCL, InfiniBand, and GPU cluster management.
• Proficiency in Python, C++, and container orchestration tools like Kubernetes.

Responsibilities

• Architect, build, and scale high-throughput, low-latency distributed training and inference systems.
• Optimize cluster utilization, network topology, and storage subsystems for massive deep learning workloads.
• Partner with research teams to remove infrastructure bottlenecks and accelerate model iteration speed.
• Troubleshoot complex distributed systems issues across thousands of hardware accelerators.

Skills

CUDA

NCCL

InfiniBand

GPU cluster management

Python

C++

Kubernetes

Education

BS or MS in Computer Science or related technical discipline

Job description

OpenAI is seeking a Senior Infrastructure Engineer to help build and scale the compute infrastructure powering state-of-the-art generative AI models in San Francisco. You will work with massive clusters of GPUs to optimize training and inference performance.

You will collaborate with research teams to remove bottlenecks, optimize networks and storage, and troubleshoot complex distributed systems across thousands of accelerators.