Multimodal AI Systems Engineer: Data Pipelines & Evaluation

Meta; Juneau (AK); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta's Applied AI (AAI) unit seeks a senior software engineer to advance multimodal data pipelines and evaluation for audio, speech, image, and video tasks. You will own end-to-end data production, measurement, and quality standards across modalities.

Responsibilities include building scalable pipelines, integrating human-in-the-loop designs, and mentoring teammates while advancing state-of-the-art multimodal research into production.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or related technical field.
• 6+ years of programming experience in a relevant language or 3+ years of experience + PhD.
• 3+ years building ML systems in production or research settings
• Strong Python and PyTorch
• Demonstrated experience with speech, audio, or music ML (ASR, TTS, codecs, music info retrieval, self-supervised audio representations, or audio generative modeling)
• Experience with large-scale data pipelines and distributed training
• Track record of translating research ideas into working, measurable systems

Responsibilities

• Design and build agentic workflows and pipelines, including human-in-the-loop and expert-in-the-loop designs, to automate data production and scale output beyond manual authoring.
• Design and own data pipelines at scale: ingestion, filtering, pseudo-labeling and captioning with attribute classifiers, and provenance tracking for audio corpora.
• Build evaluation infrastructure: objective metrics (speaker/style similarity, codec and generator quality), listening-test pipelines, and the correlation analysis that ties the two together.
• Improve training efficiency and reliability — distributed training, GPU utilization, codec and tokenizer retraining, experiment management.
• Reproduce and extend state‑of‑the‑art research: implement new methods from papers into our codebases and run rigorous ablations.
• Mentor engineers on the team, contribute to hiring and onboarding, and raise the bar on evaluation and quality practice.
• Build and train generative and representation models for speech, sound, and music — including text-, audio-, and video-conditioned generation, infilling, editing, and style transfer.

Skills

Python

PyTorch

ML systems

Data pipelines

Distributed training

Model evaluation

Mentoring

Education

Bachelor's degree in Computer Science / related field

PhD (optional)

Job description

Meta's Applied AI (AAI) unit seeks a senior software engineer to advance multimodal data pipelines and evaluation for audio, speech, image, and video tasks. You will own end-to-end data production, measurement, and quality standards across modalities.

Responsibilities include building scalable pipelines, integrating human-in-the-loop designs, and mentoring teammates while advancing state-of-the-art multimodal research into production.