RE/RS, Data Understanding - Foundations

OpenAI; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

OpenAI is seeking researchers to advance how pretraining data is built and understood at scale. You will treat data quality and curation as core research problems, developing methods to select, combine, and transform data to improve model capabilities.

Collaborating with frontier models and web-scale data, you will design experiments to understand how data choices affect learning and translate findings into scalable data processing pipelines.

Qualifications

• Strong track record in ML ideas via publications, projects or applied research.
• Own and drive a research agenda from problem selection to long-running impact.
• Experience in data-centric AI and large-scale data processing.

Responsibilities

• Develop methods to select, combine and transform data for improved model capabilities.
• Create high quality datasets and their quantized representations for pretraining.
• Design rigorous experiments to understand how data choices affect learning and downstream behavior.
• Translate research findings into scalable data processing pipelines.

Skills

Data quality

Research

Experimentation

ML concepts

Education

PhD in ML/CS

Tools

Python

PyTorch

TensorFlow

Job description

About The Team

The Data Understanding team is responsible for creating the high quality datasets and their quantized representation for OpenAI. This includes synthesizing data, building VQ representations, and processing, filtering, deduplication, quality control, and tokenization so it can be used effectively in big model training runs.

About The Role

We're looking to advance how OpenAI builds and understands pretraining data at scale. You'll treat data quality and curation as core research problems: developing new methods to select, combine, and transform data; creating datasets that improve model capabilities; and designing rigorous experiments to understand how data choices and interventions affect model learning and downstream behavior. You'll work closely with frontier models and web-scale data to build evidence for which approaches work and why, then translate successful research into scalable data processing pipelines

We Expect You To Have a strong track record of new or improved ML ideas, through publications, projects, or applied research. Own and drive a research agenda, from choosing the right problems to carrying long-running work through to impact. Be excited by OpenAI’s empirical, collaborative approach to research.

Nice To Have Thoughtfulness about AI’s impact, including privacy, provenance, and data quality. Experience building high-performance deep learning or large-scale data processing systems.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer