Data Engineer, AI Infrastructure Analytics

OpenAI; San Francisco (CA); On-site; USD 120,000 - 150,000; Full time

Job summary

OpenAI is looking for a Data Engineer to build and scale data products that support its infrastructure operations. This role involves designing data pipelines, developing datasets for critical operational metrics, and collaborating with various teams including Hardware Operations and Finance.

The successful candidate will possess strong SQL and programming skills with proven experience in managing production data workflows. This position is essential for enhancing decision-making processes at OpenAI, contributing to the growth of its AI infrastructure.

Qualifications

• 5+ years of experience building and maintaining production data pipelines.
• Strong proficiency in SQL and experience designing scalable data models.
• Experience working with modern data warehouses like Snowflake and orchestration frameworks.

Responsibilities

• Design and maintain scalable data pipelines for infrastructure operations.
• Develop datasets and reporting systems for hardware inventory and capacity utilization.
• Collaborate with stakeholders to define metrics and improve decision-making.

Skills

Data pipeline development

SQL proficiency

Python programming

ETL workflows

Data quality monitoring

Tools

Snowflake

Airflow

Spark

Job description

OpenAI is looking for a Data Engineer to build and scale data products that support its infrastructure operations. This role involves designing data pipelines, developing datasets for critical operational metrics, and collaborating with various teams including Hardware Operations and Finance.

The successful candidate will possess strong SQL and programming skills with proven experience in managing production data workflows. This position is essential for enhancing decision-making processes at OpenAI, contributing to the growth of its AI infrastructure.