Research Engineer, Language - Generative AI

AECOM; New York (NY); On-site; USD 177,000 - 251,000; Full time

Job summary

A leading company in the internet sector seeks a Research Engineer for its LLM Research team. This role involves the development and evaluation of cutting-edge LLMs, necessitating expertise in generative AI, natural language processing, and machine learning. Candidates will design innovative methodologies and contribute to both research and engineering goals, collaborating with a globally distributed team and having opportunities for direct publication at top AI conferences.

Benefits

Bonus

Equity

Benefits

Qualifications

• Experience in machine learning and NLP with research background.
• Hands-on programming experience in Python, particularly with frameworks like PyTorch.
• Research experience in developing machine learning models at scale.

Responsibilities

• Design methods and tools to enhance LLMs.
• Contribute to experiments and evaluations for LLMs.
• Work collaboratively with a distributed team.

Skills

Machine Learning

Deep Learning

Natural Language Processing

Generative AI

Python

PyTorch

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science

PhD in AI or related field

Job description

**Summary:**

Meta is seeking a Research Engineer to join our Large Language Model (LLM) Research team. We conduct focused research and engineering to build state-of-the-art LLMs, which we often open-source, like our team’s recent Llama 2. We are looking for strong engineers who have a background in generative AI and NLP, with experience in areas like language model evaluation; data processing for pre-training and fine-tuning; responsible LLMs; LLM alignment; reinforcement learning for language model tuning; efficient training and inference; and/or multilingual and multimodal modeling.

**Required Skills:**

Research Engineer, Language - Generative AI Responsibilities:

1. Design methods, tools, and infrastructure to push forward the state of the art in large language models.

2. Define research goals informed by practical engineering concerns.

3. Contribute to experiments, including designing experimental details, writing reusable code, running evaluations, and organizing results.

4. Adapt standard machine learning methods to best exploit modern parallel environments (e.g. distributed clusters, multicore SMP, and GPU).

5. Work with a large and globally distributed team.

6. Contribute to publications and open-sourcing efforts.

**Minimum Qualifications:**

Minimum Qualifications:

7. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.

8. Research experience in machine learning, deep learning, and/or natural language processing.

9. Experience with developing machine learning models at scale from inception to business impact.

10. Programming experience in Python and hands-on experience with frameworks such as PyTorch.

11. Exposure to architectural patterns of large scale software applications.

**Preferred Qualifications:**

Preferred Qualifications:

12. Master's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.

13. A PhD in AI, computer science, data science, or related technical fields.

14. Direct experience in generative AI and LLM research.

15. First author publications at peer-reviewed AI conferences (e.g., NeurIPS, CVPR, ICML, ICLR, ICCV, and ACL).

**Public Compensation:**

$85.10/hour to $251,000/year + bonus + equity + benefits

**Industry:** Internet

**Equal Opportunity:**

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].