Research Engineer: MoE LLM Infrastructure for Flexible Data

The Allen Institute for Artificial Intelligence; Seattle (WA); On-site; USD 128,880 - 193,320; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401k plan

$125 monthly for commuting expenses

$200 monthly for fitness expenses

Generous paid vacation and sick leave

Job summary

A research institute for AI in Seattle is seeking a Research Engineer 2 for the FlexOlmo team. This role involves building infrastructure for next-gen language models designed for flexible data use. Candidates should have strong expertise in deep learning and NLP, with at least 4 years of experience in model infrastructure and strong software engineering skills. The environment is collaborative and aims for impactful AI research. Competitive salary and generous benefits offered.

Qualifications

• 4+ years of experience in model development cycle including training and evaluation.
• Strong software engineering skills with debugging proficiency.
• Familiarity with cloud computing and containerization.

Responsibilities

• Building infrastructure for LLM research on flexible data use.
• Optimising training and inference for language models.
• Collaborating with open-source communities.
• Releasing contributions as open-source software and datasets.

Skills

Deep learning

Natural language processing

Collaboration and communication

Software engineering best practices

Python

PyTorch

Education

Bachelor's degree in Data Science/CS/EE/Applied Mathematics/Statistics/ML/NLP

Tools

AWS

Docker

Job description

A research institute for AI in Seattle is seeking a Research Engineer 2 for the FlexOlmo team. This role involves building infrastructure for next-gen language models designed for flexible data use. Candidates should have strong expertise in deep learning and NLP, with at least 4 years of experience in model infrastructure and strong software engineering skills. The environment is collaborative and aims for impactful AI research. Competitive salary and generous benefits offered.