Data Engineer: Pipelines & Analytics Lead

OpenAI; San Francisco (CA); On-site; USD 235,000 - 385,000; Full time

Benefits offered by this job

Relocation assistance

Job summary

OpenAI in San Francisco is seeking a Data Engineer to lead building data pipelines and core tables powering analyses, safety systems, and product growth. You will enable researchers and engineers to access trusted data for model training and deployment, scaling with OpenAI's rapid growth.

You’ll collaborate across Research, Engineering, Product, and Design to design robust ingestion, storage, and analytics workflows.

Qualifications

• 3+ years of experience as a data engineer.
• 8+ years of software engineering experience included but not limited to data engineering.
• Proficient in Python, Scala or Java.

Responsibilities

• Design, build and manage data pipelines and data warehouse integration.
• Develop canonical datasets to track product metrics like user growth, engagement and revenue.
• Collaborate with Infrastructure, Data Science, Product, Marketing, Finance and Research to meet data needs.
• Implement robust and fault-tolerant data ingestion and processing systems.
• Contribute to data architecture and engineering decisions with your expertise.
• Ensure data security, integrity, and compliance per standards.

Skills

3+ years data engineering

8+ years software engineering

Python

Scala

Java

Tools

Hadoop

Flink

HDFS

S3

Airflow

Dagster

Prefect

Spark

Job description

OpenAI in San Francisco is seeking a Data Engineer to lead building data pipelines and core tables powering analyses, safety systems, and product growth. You will enable researchers and engineers to access trusted data for model training and deployment, scaling with OpenAI's rapid growth.

You’ll collaborate across Research, Engineering, Product, and Design to design robust ingestion, storage, and analytics workflows.