Pretraining Data Architect & Experiment Lead

Mirendil Inc.; San Francisco (CA); In loco; USD 300.000 - 400.000; Tempo pieno

Descrizione del lavoro

Mirendil is building frontier AI research capabilities and scaling its own models. You will set the data strategy for pretraining, design ablations, and direct agents to run experiments with researchers who own architecture and training runs.

You will extend data pipelines, improve data extraction and deduplication, and develop data scaling plans for each run. Strong Python, Spark, PyTorch/JAX experience and clear written reasoning are highly valued.

Competenze

• Proven experience shipping data changes in large pretraining runs.
• Experience building data pipelines at trillions of tokens with Spark, Ray, Beam or similar.
• Ability to run training experiments using PyTorch or JAX.
• Hands-on experience with deduplication, quality classifiers, mixture optimization, data scaling laws, or long-context and code data.
• Excellent written communication to explain experimental results.

Mansioni

• Set the direction for data used in model training and run ablations and analyses.
• Direct agents to run experiments and pipelines in parallel.
• Design data mixtures and scaling strategies for each run.
• Extend data pipelines into scientific domains and improve data extraction and deduplication.
• Keep corpus provenance and reproducibility, decontamination for evals.
• Collaborate with researchers who own architecture and training runs.

Conoscenze

Python

Data pipelines

Pytorch

JAX

Data quality

Experiment design

Strumenti

Spark

Ray

Beam

Git

Descrizione del lavoro

Mirendil is building frontier AI research capabilities and scaling its own models. You will set the data strategy for pretraining, design ablations, and direct agents to run experiments with researchers who own architecture and training runs.

You will extend data pipelines, improve data extraction and deduplication, and develop data scaling plans for each run. Strong Python, Spark, PyTorch/JAX experience and clear written reasoning are highly valued.