Data Engineer: CPU & Storage Infrastructure

OpenAI; San Francisco (CA); On-site; USD 140,000 - 210,000; Full time

Job summary

OpenAI in San Francisco seeks a Data Engineer to build data systems and integrations connecting CPU, storage, and infrastructure platforms. You will design pragmatic solutions to collect, normalize, and expose infrastructure data across heterogeneous systems, balancing reliability and performance.

Collaborating with Infrastructure Engineering and Capacity teams, you will implement ingest, storage, and analytics datasets, and ensure data quality, observability, and maintainability across

Qualifications

• Bachelor's degree or equivalent practical experience.
• 4+ years in software/data/backend/infrastructure engineering.
• Strong Python programming skills and production software experience.
• Strong SQL skills with relational databases and big datasets.
• Experience integrating systems via REST APIs, SDKs, databases, object storage, messaging systems.
• Experience building batch, scheduled, or asynchronous workloads in production.
• Fundamentals: testing, debugging, version control, observability, maintainable design.
• Ability to reason about data schemas, ownership, and cross-system consistency.

Responsibilities

• Build and maintain software integrations that collect CPU, storage, capacity, inventory, and operational data from internal systems and external vendors.
• Connect heterogeneous data sources including APIs, relational databases, object storage, infrastructure services, capacity management platforms, and vendor systems.
• Design reliable ingestion mechanisms for structured and semi-structured data, including batch, scheduled, and API-driven workflows.
• Determine architecture and execution environment for new data integrations across backend services and orchestration frameworks.
• Build backend services and tooling that normalize data and expose it via databases, offline tables, and analytical datasets.
• Develop interfaces between operational systems and downstream analytics, planning, and engineering workflows.
• Collaborate with infrastructure and software teams to understand source systems, schemas, and constraints.
• Design data models to reconcile information across multiple systems and representations of capacity, inventory, and state.
• Create data-quality mechanisms and resolve discrepancies between sources.
• Improve reliability, observability, and maintainability through testing, monitoring, and automated validation.
• Support infrastructure planning and analytics by ensuring critical datasets are accurate and accessible.
• Develop reusable patterns for onboarding new data sources as OpenAI expands.

Skills

Python

SQL

REST APIs

Data integration

Batch processing

Distributed systems

Observability

Testing

Version control

Airflow

Education

Bachelor's degree in CS/Engineering

Tools

SDKs

Databases

Object storage

Messaging systems

Job description

OpenAI in San Francisco seeks a Data Engineer to build data systems and integrations connecting CPU, storage, and infrastructure platforms. You will design pragmatic solutions to collect, normalize, and expose infrastructure data across heterogeneous systems, balancing reliability and performance.

Collaborating with Infrastructure Engineering and Capacity teams, you will implement ingest, storage, and analytics datasets, and ensure data quality, observability, and maintainability across