Remote Research Engineer: Pretraining Data & Quality

Prime Intellect, Inc.; United States; Hybrid; USD 150,000 - 350,000; Full time

Benefits offered by this job

Equity incentives

Remote work options

Relocation assistance

Visa sponsorship

Team off-sites

Learning opportunities

Job summary

Prime Intellect, Inc. is seeking a data-centric engineer to shape the data behind its open models. You will build data pipelines, collect and evaluate training data, and implement quality checks to ensure coverage and contamination control.

You will run controlled experiments to guide data sources, processing choices, and model evaluations, with an emphasis on reliability and reproducibility across large-scale datasets.

Qualifications

• Proficient in Python programming.
• Experience building reliable data-processing or distributed systems.
• Experience with large datasets and tradeoffs of storage, compute, throughput, and reproducibility.
• Ability to diagnose data-quality issues and translate research goals into measurable checks and experiments.

Responsibilities

• Find, evaluate, and collect training data from web, code, and technical sources.
• Develop checks for data quality, coverage, and contamination.
• Run controlled data experiments and use model evaluations to decide data sources and processing choices.

Skills

Python

Data processing

Distributed systems

Large datasets

Data quality checks

Experiment design

Job description

Prime Intellect, Inc. is seeking a data-centric engineer to shape the data behind its open models. You will build data pipelines, collect and evaluate training data, and implement quality checks to ensure coverage and contamination control.

You will run controlled experiments to guide data sources, processing choices, and model evaluations, with an emphasis on reliability and reproducibility across large-scale datasets.