Mid-Training ML Engineer — Scale Data & Experiments

xAI; Palo Alto (CA); Presencial; USD 180.000 - 240.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Health insurance

Life and AD&D insurance

Fertility benefits

Visa sponsorship

401(k) plan

Descripción de la vacante

xAI is seeking a hands-on ML data engineer to scale data pipelines and verify large-scale models in the Bay Area. The role focuses on advancing synthetic data, model distillation, and robust evaluation across mid-training checkpoints.

You will work with cutting-edge frameworks and collaborate across teams to push capabilities in a fast-paced environment. Candidates should be located near the Bay Area or be open to relocation.

Formación

• Strong engineering abilities in Spark, Ray, and other frameworks for large-scale data processing.
• Expertise in ML and large model scaling, with familiarity across scaling laws.
• Strong ability to design ML experiments.
• Familiarity with state-of-the-art techniques for curating AI training data for text, image, audio, and video modalities.

Responsabilidades

• Scale synthetic coding data to trillions of tokens with large-scale docker verification.
• Distill the intelligence of flagship models into flash models through synthetic data generation.
• Optimize mid-training data mixtures to boost the ceiling for RL.
• Engineer long-context data recipes.
• Develop robust and diverse evaluation for mid-training checkpoints.

Conocimientos

Spark

Ray

Large-scale data processing

ML experimentation design

Data curation for AI training

Herramientas

Docker

Descripción del empleo

xAI is seeking a hands-on ML data engineer to scale data pipelines and verify large-scale models in the Bay Area. The role focuses on advancing synthetic data, model distillation, and robust evaluation across mid-training checkpoints.

You will work with cutting-edge frameworks and collaborate across teams to push capabilities in a fast-paced environment. Candidates should be located near the Bay Area or be open to relocation.