Senior Search Infrastructure Engineer for Large-Scale ML

OpenAI, Inc.; United States; Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Relocation assistance

Hybrid work model

Job summary

The company in San Francisco is seeking a senior engineer for its Search Product Infrastructure team. You will design, build, and operate systems that connect models with search at scale, tackling orchestration, inference efficiency, and production reliability to improve answer quality and user experience.

You will collaborate with researchers and partner teams, own projects from design to launch, and evolve the architecture as models and demand grow.

Qualifications

• In-depth experience designing, building and operating large-scale distributed systems.
• Experience in search, information retrieval, ML infrastructure, or high-throughput online systems.
• Strong programming and systems debugging skills across production stacks.

Responsibilities

• Design and evolve services that coordinate search classification, retrieval, ranking, and model inference.
• Improve end-to-end latency, throughput, and infrastructure efficiency with profiling and capacity planning.
• Build experimentation tooling and automation for reproducible A/B tests and safe rollouts.
• Own production reliability through observability, incident response, and automation.
• Build search APIs and interfaces for reliable model retrieval with access controls.

Skills

Distributed systems

Search/IR

ML infrastructure

Inference serving

Programming

Job description

The company in San Francisco is seeking a senior engineer for its Search Product Infrastructure team. You will design, build, and operate systems that connect models with search at scale, tackling orchestration, inference efficiency, and production reliability to improve answer quality and user experience.

You will collaborate with researchers and partner teams, own projects from design to launch, and evolve the architecture as models and demand grow.