Research Scientist Manager, Generative AI - Llama Pre-training

The Rundown AI, Inc.; New York (NY); On-site; USD 177,000 - 251,000; Full time

Job summary

A leading tech company is seeking a Research Scientist Manager specializing in Generative AI. This role involves developing large language models, leading research teams, and collaborating across functions. The ideal candidate will have extensive experience in NLP and a proven track record in generative AI technologies. The position offers a competitive salary and benefits, with opportunities to shape the future of AI.

Benefits

Bonus

Equity

Comprehensive Benefits

Qualifications

• 5+ years of experience in large language models and NLP.
• 3+ years leading teams of research scientists and engineers.

Responsibilities

• Drive end-to-end development of large language models.
• Lead a team to democratize Llama for users.

Skills

NLP

Data Curation

Team Leadership

Generative AI

Education

PhD in Deep Learning

Tools

PyTorch

TensorFlow

Spark

Hive

LangChain

Job description

Research Scientist Manager, Generative AI - Llama Pre-training

The Generative AI organization at Meta is seeking a Research Scientist Manager to join our team and work on the next generation of large language models, particularly focusing on pre-training and mid-training data. As a Research Scientist Manager, you will play a critical role in building our series of Llama models and setting direction from the earliest stages, with a focus on data including curation, ablations, scaling laws, and defining new tasks (e.g., reasoning, coding). Data is the single largest lever we have to improve our models.

Responsibilities:

1. Drive end-to-end development of large language models, including data sourcing and curation, filtering, experiment design, evaluation, and more.
2. Drive efficiency gains on training and deployment of LLMs through novel techniques.
3. Lead a team of applied researchers to democratize Llama for Meta's users.
4. Communicate, collaborate, and build relationships with clients and peer teams to facilitate cross-functional projects.
5. Stay up-to-date on ongoing research and software development activities within the team, help work through technical challenges, and be involved in design decisions.
6. Remain involved in the research community, understanding trends, and setting them.

Minimum Qualifications:

1. 5+ years of hands-on experience in large language models, NLP, and Transformer modeling, in both research and engineering development.
2. Track record of impactful research and/or product contributions in a fast-paced environment.
3. 3+ years of experience leading teams of research scientists and software engineers.
4. Proven technical vision for the future of generative AI.
5. Knowledge of data curation techniques (training set preparation, ablation experiments, etc.).
6. Experience collaborating with cross-functional teams, including non-engineering functions.
7. Experience recruiting, building, structuring, and leading technical organizations, including performance management.

Preferred Qualifications:

1. PhD in deep learning, artificial intelligence, or related fields.
2. Experience with ML frameworks like PyTorch, TensorFlow, etc.
3. Knowledge of large-scale data platforms such as Spark, Hive, etc.
4. Experience with LLM frameworks like LangChain.
5. Experience training LLMs, fine-tuning on datasets, especially Llama.

About Meta:

Meta builds technologies that help people connect, find communities, and grow businesses. From Facebook's launch in 2004 to the development of apps like Messenger, Instagram, and WhatsApp, Meta continues to innovate towards immersive experiences like augmented and virtual reality. We are committed to shaping a future beyond today's digital connection, transcending screens, distances, and even the rules of physics.

Meta is an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based on race, religion, color, national origin, sex, sexual orientation, gender identity, age, veteran status, disability, or other protected characteristics. We consider qualified applicants with criminal histories, consistent with applicable law. Meta participates in the E-Verify program where required. We may use AI and machine learning in our hiring process.

We are committed to providing reasonable accommodations for candidates with disabilities. Please contact us at [e-mail] if needed.

Compensation:

$177,000/year to $251,000/year + bonus + equity + benefits. Compensation varies based on skills, qualifications, experience, and location. Benefits details are available at Meta.