Data Platform Engineer for Frontier Model Pretraining

Cursor

Palo Alto (CA)

On-site

USD 160,000 - 250,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Health insurance
Vision insurance
Dental insurance
401(k)
Disability insurance
Life insurance
Employee discounts

Job summary

SpaceXSI is seeking a Software Engineer to build data systems behind frontier models' initial training. You will craft large-scale crawling, data platform, and pipeline infrastructure, turning raw dumps into training-ready datasets and enabling fast, reliable iteration with researchers.

The role emphasizes end-to-end ownership of data quality, scalability, and collaboration with training, crawling, and acquisition teams. Onsite in Palo Alto, strong data infra skills required.

Qualifications

  • Minimum of 3 years of software engineering experience.
  • Experience building distributed systems and/or large-scale data infrastructure.

Responsibilities

  • Build the platform that turns raw web, code, multimodal, and acquired data into training-ready datasets for frontier pretraining runs.
  • Own the pipelines, orchestration, and tooling that make pretraining data iteration fast, reliable, observable, and reproducible at scale.
  • Create signals for data quality, lineage, freshness, and pipeline health so researchers can trust what goes into each run.
  • Partner with initial training, crawling, data quality, and acquisition teams to turn new data ideas into measurable improvements in loss, evals, and model capability.
  • Build and own high-throughput, fully telemetered data pipelines that process frontier-scale data with end-to-end traceability.
  • Train and ship models that classify, rank, filter, clean, and identify data at extreme throughput.
  • Design and run scaling-ladder experiments on data-mixture, repeatability, and quality depth that turn 'this dataset feels good' into hard evidence the training team can trust.
  • Partner tightly with Data Acquisition to hunt down missing or low-quality sources, and with the training teams to close the loop on what actually moves loss and downstream evals.
  • Treat data quality as a systems problem and a research problem. You will write performance-critical code one week and design careful experiments the next.
  • Build and scale the web crawling systems that discover, schedule, fetch, and parse high-quality documents across the open web for initial training.
  • Improve URL seeding, scoring, and fair host scheduling so crawl capacity lands on the hosts and pages that matter most for model quality.
  • Raise crawl success and parsing quality, defeating antibot failures, improving extractors, and capturing content we previously could not get cleanly.
  • Debug and harden complex crawl infrastructure end-to-end for availability, recovery, and ingestion lag, and automate delivery of crawl datasets into the data pipeline.
  • Work independently (and alongside AI agents) and partner with Data Quality and Data Platform so new coverage shows up as better tokens in training runs.

Skills

Distributed systems
Data infrastructure
Software engineering
Ownership

Job description

SpaceXSI is seeking a Software Engineer to build data systems behind frontier models' initial training. You will craft large-scale crawling, data platform, and pipeline infrastructure, turning raw dumps into training-ready datasets and enabling fast, reliable iteration with researchers.

The role emphasizes end-to-end ownership of data quality, scalability, and collaboration with training, crawling, and acquisition teams. Onsite in Palo Alto, strong data infra skills required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Platform Engineer - Frontier Pretraining
Senior Data Platform Engineer - Frontier Pretraining

Cursor • Palo Alto (CA)

On-site
USD 220,000 - 357,000
Equity
Medical/Dental/Vision
401(k) plan
+1
Senior Data Platform Engineer - Frontier AI Training
Senior Data Platform Engineer - Frontier AI Training

Cursor • Palo Alto (CA)

On-site
USD 220,000 - 357,000
Equity
Medical coverage
401(k) retirement plan
+1
Senior Data Platform Engineer, Pretraining Data
Senior Data Platform Engineer, Pretraining Data

Cursor (Anysphere) • Palo Alto (CA)

On-site
USD 220,000 - 357,000
Equity
Medical coverage
Dental coverage
+3
Senior Pretraining Data Engineer — Palo Alto Onsite
Senior Pretraining Data Engineer — Palo Alto Onsite

Speedrun Talent Network • Palo Alto (CA)

On-site
USD 220,000 - 357,000
Equity
Medical, vision, and dental coverage
401(k) retirement plan
+2
Senior Pretraining Data Engineer – Onsite Palo Alto
Senior Pretraining Data Engineer – Onsite Palo Alto

Candidate • Palo Alto (CA)

On-site
USD 220,000 - 357,000
Equity
Medical benefits (health, vision, and‑
401(k)
Sr. Software Engineer, Pretraining Data
Sr. Software Engineer, Pretraining Data

Cursor • Palo Alto (CA)

On-site
USD 220,000 - 357,000
Equity
Medical/Dental/Vision
401(k) plan
+1
Sr. Software Engineer, Pretraining Data
Sr. Software Engineer, Pretraining Data

Speedrun Talent Network • Palo Alto (CA)

On-site
USD 220,000 - 357,000
Equity
Medical, vision, and dental coverage
401(k) retirement plan
+2
Sr. Software Engineer, Pretraining Data
Sr. Software Engineer, Pretraining Data

Candidate • Palo Alto (CA)

On-site
USD 220,000 - 357,000
Equity
Medical benefits (health, vision, and‑
401(k)
Sr. Software Engineer, Pretraining Data
Sr. Software Engineer, Pretraining Data

Cursor (Anysphere) • Palo Alto (CA)

On-site
USD 220,000 - 357,000
Equity
Medical coverage
Dental coverage
+3
Robotics Data Platform Engineer
Robotics Data Platform Engineer

WorldEngine AI • San Francisco (CA)

Hybrid
USD 140,000 - 190,000