Research Engineer - Pretraining Data (Fully Remote)

Prime Intellect, Inc.; United States; Hybrid; USD 150,000 - 350,000; Full time

Benefits offered by this job

Equity incentives

Remote work options

Relocation assistance

Visa sponsorship

Team off-sites

Learning opportunities

Job summary

Prime Intellect, Inc. is seeking a data-centric engineer to shape the data behind its open models. You will build data pipelines, collect and evaluate training data, and implement quality checks to ensure coverage and contamination control.

You will run controlled experiments to guide data sources, processing choices, and model evaluations, with an emphasis on reliability and reproducibility across large-scale datasets.

Qualifications

• Proficient in Python programming.
• Experience building reliable data-processing or distributed systems.
• Experience with large datasets and tradeoffs of storage, compute, throughput, and reproducibility.
• Ability to diagnose data-quality issues and translate research goals into measurable checks and experiments.

Responsibilities

• Find, evaluate, and collect training data from web, code, and technical sources.
• Develop checks for data quality, coverage, and contamination.
• Run controlled data experiments and use model evaluations to decide data sources and processing choices.

Skills

Python

Data processing

Distributed systems

Large datasets

Data quality checks

Experiment design

Job description

• Build the data behind Prime Intellect's next generation of open models.
• Shape both broad pretraining and the data used to develop reasoning, coding, and long-context capabilities.

Responsibilities:

• Find, evaluate, and collect training data from web, code, and technical sources.
• Develop checks for data quality, coverage, and contamination.
• Run controlled data experiments and use model evaluations to decide which sources, mixtures, and processing choices are worth scaling.

Requirements:

• Strong programming skills in Python and a record of building reliable data-processing or distributed systems.
• Experience working with large datasets and managing tradeoffs of storage, compute, throughput, and reproducibility.
• Ability to diagnose data-quality issues and translate research goals into measurable checks and experiments.

Benefits and Perks:

• Cash compensation range of $150-350k, including equity incentives.
• Flexible work arrangements with remote or in-person options in San Francisco.
• Visa sponsorship, relocation assistance, team off-sites, and learning opportunities.

Prime Intellect

Prime Intellect builds the open superintelligence stack, offering a full-stack platform for post-training frontier AI models. Backed by $150M in funding, it is a mission-driven team focused on accelerating science and AI.