Foundational LLM Data Engineer: Pre-Training & Scaling

Meta; Menlo Park (CA); Hybrid; USD 170,000 - 250,000; Full time

Job summary

Meta is seeking a Research Engineer in Menlo Park to help build data foundations for its largest language models. You will work on data curation across pre-training, mid-training, and post-training stages, shaping data for models like Llama and collaborating with researchers and engineers across MSL FAIR.

You will design scalable data pipelines, improve data velocity, and apply expertise in data tooling to advance Meta's frontier models in a fast-paced research environment.

Qualifications

• Experience in large language model data curation and preprocessing.
• Background in scalable data pipelines and data tooling.
• Familiarity with agentic data, synthetic data, or web/data parsing for ML.

Responsibilities

• Collaborate with cross-functional teams to develop Meta’s next foundational models.
• Architect efficient, scalable data curation systems and pipelines.
• Improve data velocity across workflows and projects.
• Lead high-priority pre-training, mid-training, or post-training data initiatives.

Job description

Meta is seeking a Research Engineer in Menlo Park to help build data foundations for its largest language models. You will work on data curation across pre-training, mid-training, and post-training stages, shaping data for models like Llama and collaborating with researchers and engineers across MSL FAIR.

You will design scalable data pipelines, improve data velocity, and apply expertise in data tooling to advance Meta's frontier models in a fast-paced research environment.