AI Research Engineer, VLLM (vision large language models) - Generative AI

The Rundown AI, Inc.; New York (NY); On-site; USD 7,000 - 208,000; Full time

Job summary

Meta is seeking a Research Engineer for their Llama LLM Research team, focusing on vision large language models. The role involves leading data curation and model development, collaborating with teams, and mentoring members. Ideal candidates have strong AI backgrounds and experience in software development.

Benefits

Bonus

Equity

Benefits

Qualifications

• 3+ years of experience in industry, academia, or government research roles.
• Publications in machine learning, computer vision, NLP, or audio.

Responsibilities

• Lead and execute on developing scalable data curation and model development.
• Design experiments, write reusable code, and run evaluations.

Skills

Python

Problem Solving

Education

Bachelor's degree in Computer Science

Master's degree in AI

PhD in AI

Tools

PyTorch

Job description

Meta is seeking a Research Engineer to join our Llama Large Language Model (LLM) Research team. We are looking for recognized experts in VLLMs, with experience in areas like vision encoders, data filtering/curation for pre and post-training, RLHF, responsible AI, and model controllability. The ideal candidate will have an interest in producing and applying new science, systems, and technologies to help develop and responsibly release vision large language models.

AI Research Engineer, VLLM (vision large language models) - Generative AI Responsibilities:

1. Lead, collaborate, and execute on developing scalable and effective data curation, model development, and evaluation systems that advance multimodal reasoning and generation research.
2. Work towards long-term ambitious research and development goals, while identifying intermediate milestones.
3. Design experiments, write reusable code, run evaluations, and organize results.
4. Collaborate within a large team.
5. Mentor team members and foster healthy cross-functional collaboration.
6. Prioritize research and development that can be applied to Meta's products.

Minimum Qualifications:

1. Bachelor's degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience.
2. Master's degree in AI, computer science, or related fields.
3. 3+ years of experience in industry, academia, or government research roles.
4. Publications in machine learning, computer vision, NLP, or audio.
5. Experience in software development and executing complex experiments with large AI models and datasets.
6. Work authorization in the country of employment at the time of hire, and ongoing during employment.

Preferred Qualifications:

1. Experience in generative AI and LLM research in industry.
2. Ability to solve complex problems, evaluate alternatives, and consider different perspectives.
3. Fluency in Python and PyTorch (or similar frameworks).
4. Publication record at peer-reviewed AI conferences (e.g., NeurIPS, CVPR, ICML, ICLR, ICCV, ACL).
5. PhD in AI, computer science, or related fields.

About Meta:

Meta builds technologies that help people connect, find communities, and grow businesses. From Facebook's launch in 2004 to apps like Messenger, Instagram, and WhatsApp, Meta has empowered billions worldwide. Moving beyond 2D screens, Meta is developing immersive experiences like augmented and virtual reality to shape the future of social technology. Careers at Meta involve helping to build a future that transcends current digital limitations.

Meta is an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based on race, religion, color, national origin, sex, sexual orientation, gender identity, age, veteran status, disability, or other protected characteristics. Qualified applicants with criminal histories are also considered, consistent with law. Meta participates in the E-Verify program where required. We may use AI and machine learning in our hiring process.

Meta provides reasonable accommodations for candidates with disabilities. Contact [e-mail] for assistance.

Compensation and Benefits:

$70.67/hour to $208,000/year + bonus + equity + benefits. Compensation depends on skills, qualifications, experience, and location. Benefits details are available at Meta.