Data Engineer, Analytics — Build Scalable AI Pipelines

Talantir; San Francisco (CA); On-site; USD 230,000 - 385,000; Full time

Job summary

OpenAI is seeking a Data Engineer to lead the design, build, and management of data pipelines and core tables powering analyses, safety systems, product growth, and revenue insights. You will collaborate with researchers behind ChatGPT and help train models for deployment to users.

This role is based in our San Francisco HQ with relocation assistance. You will work with teams across Infrastructure, Data Science, Product, Marketing, Finance, and Research to ensure secure, compliant data practices

Qualifications

• 3+ years of experience as a data engineer and 8+ years of any software engineering experience.
• Proficiency in Python, Scala, or Java.
• Experience with distributed processing technologies and storage systems (Hadoop, Flink, HDFS, S3).

Responsibilities

• Design, build and manage data pipelines to feed our data warehouse and analyses.
• Develop canonical datasets for key product metrics like user growth, engagement, and revenue.
• Collaborate with Infrastructure, Data Science, Product, Marketing, Finance, and Research to meet data needs.
• Implement robust, fault-tolerant data ingestion and processing systems.
• Contribute to data architecture and engineering decisions.

Skills

Data pipelines

Software engineering

Python

Scala

Java

Airflow

Spark

Hadoop

Flink

S3/HDFS

Tools

Airflow

Dagster

Prefect

Spark

Job description

OpenAI is seeking a Data Engineer to lead the design, build, and management of data pipelines and core tables powering analyses, safety systems, product growth, and revenue insights. You will collaborate with researchers behind ChatGPT and help train models for deployment to users.

This role is based in our San Francisco HQ with relocation assistance. You will work with teams across Infrastructure, Data Science, Product, Marketing, Finance, and Research to ensure secure, compliant data practices