Technical Lead Manager, Data Movement for Training

OpenAI; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

OpenAI is seeking a deeply hands-on Technical Lead Manager to own datasets throughout our training infrastructure. You will set direction for how training jobs read data, APIs, storage contracts, versioning models, benchmarks, debugging tools, and reliability guarantees for data access across frameworks.

You will begin as the primary technical owner for dataset reads, align researchers and teams around a durable platform, and scale to broader data movement responsibilities over time.

Qualifications

• Experience building dataset read platforms for large-scale training systems.
• Strong understanding of APIs, storage formats, registration/versioning and migration paths.
• Ability to build reliable read paths with stateful iteration, caching, fast restart and recovery.
• Comfort working across Python and lower-level systems (Rust/C++).
• Experience with multimodal or RL data pipelines is a plus.

Responsibilities

• Design and build a unified dataset read platform for multiple training frameworks.
• Define dataset APIs, storage-format expectations, registration/versioning, and migration paths.
• Build reliable read paths with stateful iteration, caching, fast restart, and operational contracts.
• Create terminal and web visualizers to inspect data late in the pipeline.
• Write and review production code in data loading, service, caching, and reliability paths.
• Collaborate with teams on training frameworks, reinforcement learning, multimodal models, storage, runtime, and cluster infra.

Skills

Python

Distributed systems

API design

Data loading infra

Tools

Rust

C++

Job description

OpenAI is seeking a deeply hands-on Technical Lead Manager to own datasets throughout our training infrastructure. You will set direction for how training jobs read data, APIs, storage contracts, versioning models, benchmarks, debugging tools, and reliability guarantees for data access across frameworks.

You will begin as the primary technical owner for dataset reads, align researchers and teams around a durable platform, and scale to broader data movement responsibilities over time.