Senior Infrastructure Engineer, AI

AI Breaking Wire; San Francisco (CA); On-site; USD 280,000 - 400,000; Full time

Benefits offered by this job

Equity

Medical, dental, and vision benefits

Unlimited PTO

Parental leave (flexible)

Learning stipend

Job summary

OpenAI is seeking a Senior Infrastructure Engineer to help build and scale the compute infrastructure powering state-of-the-art generative AI models in San Francisco. You will work with massive clusters of GPUs to optimize training and inference performance.

You will collaborate with research teams to remove bottlenecks, optimize networks and storage, and troubleshoot complex distributed systems across thousands of accelerators.

Qualifications

• 5+ years of experience in software engineering with a focus on large-scale distributed systems or ML infrastructure.
• Deep expertise in CUDA, NCCL, InfiniBand, and GPU cluster management.
• Proficiency in Python, C++, and container orchestration tools like Kubernetes.

Responsibilities

• Architect, build, and scale high-throughput, low-latency distributed training and inference systems.
• Optimize cluster utilization, network topology, and storage subsystems for massive deep learning workloads.
• Partner with research teams to remove infrastructure bottlenecks and accelerate model iteration speed.
• Troubleshoot complex distributed systems issues across thousands of hardware accelerators.

Skills

CUDA

NCCL

InfiniBand

GPU cluster management

Python

C++

Kubernetes

Education

BS or MS in Computer Science or related technical discipline

Job description

# Senior Infrastructure Engineer, AIOpenAI## Job Description### About the RoleOpenAI is seeking a Senior Infrastructure Engineer to help build and scale the compute infrastructure powering our state-of-the-art generative AI models. You will work with massive clusters of GPUs to optimize training and inference performance.### Responsibilities- Architect, build, and scale high-throughput, low-latency distributed training and inference systems.- Optimize cluster utilization, network topology, and storage subsystems for massive deep learning workloads.- Partner with research teams to remove infrastructure bottlenecks and accelerate model iteration speed.- Troubleshoot complex distributed systems issues across thousands of hardware accelerators.### Requirements- 5+ years of experience in software engineering with a focus on large-scale distributed systems or ML infrastructure.- Deep expertise in CUDA, NCCL, InfiniBand, and GPU cluster management.- Proficiency in Python, C++, and container orchestration tools like Kubernetes.- BS or MS in Computer Science or a related technical discipline.### Benefits- Industry-leading compensation including equity.- Top-tier medical, dental, and vision benefits.- Unlimited paid time off and flexible parental leave.- Annual learning and development stipend.## Skills & Tagspythonc++cudakubernetesdistributed-systemsinfrastructure## Job DetailsFull-timeSan Francisco, CA$280k – $400k USDPosted July 30, 2026Expires September 28, 2026