Software Engineer, Infrastructure - Analytics Platform OpenAI San Francisco

Neura Market; San Francisco, Northern (CA, KY); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Relocation assistance

Hybrid work model

Job summary

OpenAI is seeking a senior software engineer to design, develop, and operate production‑critical software infrastructure end to end. The role emphasizes backend/system engineering with a focus on low‑level performance, scalability, and distributed systems. You will ship Rust or C++ services and operate them in production at scale.

Based in San Francisco, this hybrid role includes relocation assistance. You will own infrastructure across the full lifecycle, collaborating with researchers to

Qualifications

• Operationally critical systems end to end in ambiguous environments.
• Hands-on experience building performance-sensitive backend systems in Rust or C++.
• Experience designing, building, or operating distributed systems or distributed databases at scale.
• Production infrastructure and delivery tooling: Kubernetes, Terraform, Prometheus, CI/CD pipelines.

Responsibilities

• Own critical infrastructure across design, implementation, rollout, operation, and iteration.
• Build and operate performant backend systems in Rust or C++ that support core research workflows.
• Design and improve distributed data and serving systems, including partitioning, replication, consistency, retries, backpressure, and failure isolation.
• Debug real production bottlenecks across latency, throughput, contention, hot spots, and overload behavior.
• Operate business-critical services through on-call, incidents, postmortems, observability, alerting, safe rollouts, rollback plans, and zero-downtime migrations.
• Improve reliability of services running on Kubernetes, including resource tuning, failure handling, and production readiness.
• Partner with engineers and researchers to deliver fast, reliable systems.
• Raise the bar through strong technical judgment, ownership, and follow-through.

Skills

Rust

C++

Kubernetes

CI/CD

Prometheus

Observability

Tools

Terraform

ClickHouse-like systems

Job description

About the Team

The Scaling team designs, builds, and operates critical infrastructure that enables research at OpenAI.

Our mission is simple: accelerate the progress of research towards AGI. We do this by building core systems that researchers rely on - ranging from low-level infrastructure components to research-facing custom applications. These systems must scale with the increasing complexity and size of our workloads, while remaining reliable and easy to use.

About the Role

We’re looking for an experienced software engineer to design, develop, and operate production‑critical software infrastructure end to end across its full production lifecycle.

This role is centered on backend / systems engineering, with emphasis on low-level performance, scalability, distributed systems, and hands‑on development and operation of critical services at scale. You’ll take ambiguous problems, turn them into concrete plans, ship pragmatic solutions quickly, and improve them through production feedback and iteration.

This is not a general Python backend role. We’re specifically looking for strong systems experience in Rust or C++, especially in performance‑sensitive infrastructure.

This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.

In this role, you will:

• Own critical infrastructure across design, implementation, rollout, operation, and iteration.
• Build and operate performant backend systems in Rust or C++ that support core research workflows.
• Design and improve distributed data and serving systems, including tradeoffs around partitioning, replication, consistency, retries, backpressure, and failure isolation.
• Debug real production bottlenecks across latency, throughput, contention, hot spots, and overload behavior.
• Operate business‑critical services through on‑call, incidents, postmortems, observability, alerting, safe rollouts, rollback plans, and zero‑downtime migrations.
• Improve reliability of services running on Kubernetes, including resource tuning, failure handling, and production readiness.
• Partner closely with engineers and researchers to deliver fast, reliable, useful systems.
• Raise the bar through strong technical judgment, ownership, and follow‑through.

You might thrive in this role if you have:

• A track record of owning operationally critical systems end to end and delivering outcomes in ambiguous environments.
• Strong hands‑on experience building performance-sensitive backend systems in Rust or C++.
• Comfort working below typical service abstractions, including concurrency, async execution, memory behavior, serialization, I/O, networking, profiling, and failure analysis.
• Experience designing, building, or operating distributed systems or distributed databases at meaningful scale.
• Preferably, experience with ClickHouse‑like systems or infrastructure for analytics, telemetry, logging, search, ingestion, storage, or query execution.
• Hands‑on experience with production infrastructure and delivery tooling, including Kubernetes, Terraform or equivalent infrastructure‑as‑code tooling, Prometheus or equivalent observability / metrics tooling, and CI/CD pipelines or equivalent release automation.
• Hands‑on experience operating production‑critical systems across the full lifecycle, including incidents, observability, alerting, safe rollouts, rollback plans, and recurrence prevention.
• Strong judgment in balancing engineering quality, speed, risk, and business impact.
• A habit of shipping practical first versions and improving them through production feedback.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general‑purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US‑based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non‑public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non‑compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.