Research Engineer, Pre-training Data - MSL FAIR

Meta; Menlo Park (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Meta is seeking AI research engineers to build the data foundation for its most advanced Large Language Models. The role focuses on data curation, pre-training and mid-training data management, and developing data tooling to support trillion-scale datasets.

You will contribute to frontier models like Llama within FAIR. Based in Meta Superintelligence Labs (MSL), you will collaborate across researchers and engineers, influence strategy, and publish impactful work at top AI conferences while

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• 2+ years of industry research experience in LLM/NLP or related AI/ML models.
• Experience as a formal technical lead, leading major technical initiatives with cross-functional impact, and/or influencing strategy across multiple teams.
• Practical experience with pre-training or mid-training data curation for large foundational models and experience working with organic, synthetic, agentic, or reasoning data for LLMs.
• Demonstrated data infrastructure and software background, and experience building data tooling and services.
• Published research in leading peer-reviewed conferences (e.g., NeurIPS, ICML, ICLR, ACL, EMNLP) and/or demonstrated significant industry influence in the field of AI.
• Hands-on experience with modeling frameworks like PyTorch.
• Hands-on experience on SQL and large-scale data handling, with familiarity of frameworks like Spark and Hive.

Skills

LLM/NLP experience

Technical leadership

Cross-functional collaboration

Data curation

Research experience

Language models

Education

Bachelor's degree in CS/CE or equivalent

Master's degree or PhD in CS or related field

Tools

PyTorch

SQL

Spark

Hive

Data tooling

Job description

Meta is seeking AI research engineers to help us build the data foundation for Meta's most advanced Large Language Models. We're looking for engineers with LLM expertise to join us on working with data at scale and to push beyond the data ceiling.

Our team contributes to data curation across all stages of LLM development (pre-training, mid-training, post-training) and all domains/modalities (e.g., web, code, agent, multilingual). We tackle the hardest challenges at trillion-scale, including organic data curation, synthetic data generation, agent and interaction data, and frontier paradigms that redefine what's possible.

Based in Meta Superintelligence Labs (MSL) within the Fundamental AI Research Organization (FAIR), you'll directly contribute to Meta's frontier models like Llama, while having the chance to collaborate with researchers and engineers across MSL. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience2+ years of industry research experience in LLM/NLP or related AI/ML modelsExperience as a formal technical lead, leading major technical initiatives with cross-functional impact, and/or influencing strategy across multiple teamsPractical experience with pre-training or mid-training data curation for large foundational models and experience working with organic, synthetic, agentic, or reasoning data for LLMsDemonstrated data infrastructure and software background, and experience building data tooling and servicesPublished research in leading peer-reviewed conferences (e.g., NeurIPS, ICML, ICLR, ACL, EMNLP) and/or demonstrated significant industry influence in the field of AI Experience working on frontier-quality/state-of-the-art Large Language ModelsMasters degree or PhD in Computer Science or a related technical fieldHands-on experience with modeling frameworks like PyTorchHands-on experience on SQL and large-scale data handling, with familiarity of frameworks like Spark and Hive