Data Pipeline Engineer for Frontier Pretraining

Anysphere; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Anysphere is seeking Software Engineers to build data systems behind frontier coding models’ training. You’ll work on crawling, data platforms, and pipelines turning raw dumps into training-ready datasets, enabling researchers to iterate quickly.

On the Data Quality, Data Platform, and Crawling teams you will own high-throughput pipelines, drive data quality, and scale web crawling infrastructure to feed model training, with end-to-end ownership and rigorous reliability.

Responsibilities

• Build and own high-throughput, fully telemetered data pipelines that process frontier-scale data with end-to-end traceability.
• Train and ship models that classify, rank, filter, clean, and identify data at extreme throughput.
• Design and run scaling-ladder experiments on data-mixture, repeatability, and quality depth.

Job description

Anysphere is seeking Software Engineers to build data systems behind frontier coding models’ training. You’ll work on crawling, data platforms, and pipelines turning raw dumps into training-ready datasets, enabling researchers to iterate quickly.

On the Data Quality, Data Platform, and Crawling teams you will own high-throughput pipelines, drive data quality, and scale web crawling infrastructure to feed model training, with end-to-end ownership and rigorous reliability.