Distributed Runtime Foundations Engineer

OpenAI; San Francisco (CA); Hybrid; USD 220,000 - 300,000; Full time

Benefits offered by this job

Relocation assistance

Job summary

OpenAI is seeking a Training Runtime: Runtime Foundations Engineer in San Francisco, CA to help tie thousands of computers into a unified, high-performance system. You will work primarily in Codex + Rust, building asynchronous components to orchestrate and monitor ML workloads on our largest clusters.

You will optimize for scale, reliability, and observability, and collaborate across Python and Rust stacks while diving into novel domains and demanding performance challenges.

Qualifications

• Experience developing distributed systems.
• Strong understanding of large-scale system behavior and failure modes.
• Proficiency in Rust or another systems language.
• Solid Linux knowledge and memory profiling.
• Experience with asynchronous and concurrent systems.

Responsibilities

• Work across our Python and Rust stack.
• Design, build, and maintain software to orchestrate and monitor machine learning workloads on our largest supercomputers.
• Profile and optimize our software stack to support computation orchestration at frontier scale.
• Improve reliability, observability, and fault tolerance for long-running jobs.
• Debug complex distributed systems issues across large clusters.
• Respond to the changing shapes and needs of the ML systems to enable our researchers.

Skills

Distributed systems

Rust

C/C++

Linux

Asynchronous programming

Performance optimization

Job description

OpenAI is seeking a Training Runtime: Runtime Foundations Engineer in San Francisco, CA to help tie thousands of computers into a unified, high-performance system. You will work primarily in Codex + Rust, building asynchronous components to orchestrate and monitor ML workloads on our largest clusters.

You will optimize for scale, reliability, and observability, and collaborate across Python and Rust stacks while diving into novel domains and demanding performance challenges.