Engineering Manager, ChatGPT Search Infrastructure

OpenAI; San Francisco (CA); On-site; USD 230,000 - 300,000; Full time

Job summary

OpenAI is seeking an Engineering Manager to lead the ChatGPT Search Infrastructure team in San Francisco. You will set technical direction for search orchestration, model integration, and serving infrastructure, guiding architecture and product integrations at global scale.

You will empower engineers to own major technical areas, ensure reliability and latency targets, and collaborate with product, research, and infrastructure teams to deliver high-quality search experiences.

Responsibilities

• Define and drive the technical strategy, architecture, and roadmap for ChatGPT Search Infrastructure, spanning search orchestration, APIs, model and prompt integration, serving, experimentation, evaluation, observability, and product integrations.
• Lead and develop a team of experienced engineers, create meaningful ownership opportunities, and foster an inclusive, high-trust culture with clear accountability and high standards.
• Partner with Post-Training on model launches, A/B experiments, search-behavior evaluation, and prompt optimization, translating model improvements into production-ready product experiences.
• Build reusable platforms that enable Search product vertical teams to independently implement, test, and launch features, with automated guardrails that protect reliability, scalability, quality, and latency.
• Partner with Inference, Indexing, and Retrieval teams to evolve the end-to-end Search architecture, adapt serving optimizations, and improve product outcomes across the stack.
• Define and uphold service objectives of at least 99.9% availability, sub-second latency where required by the user experience, and the scalability needed to support ChatGPT’s continued growth.
• Establish strong engineering practices across system design, testability, observability, experimentation, capacity planning, rollout safety, operational readiness, and incident prevention.
• Independently lead multiple complex workstreams, remove technical and organizational bottlenecks, and build alignment across product, research, and infrastructure teams in ambiguous and rapidly changing environments.

Job description

OpenAI is seeking an Engineering Manager to lead the ChatGPT Search Infrastructure team in San Francisco. You will set technical direction for search orchestration, model integration, and serving infrastructure, guiding architecture and product integrations at global scale.

You will empower engineers to own major technical areas, ensure reliability and latency targets, and collaborate with product, research, and infrastructure teams to deliver high-quality search experiences.