Multimodal AI Engineer: Scalable Media Pipelines & Evaluation

Meta; Madison (WI); Remote; USD 154,000 - 217,000; Full time

Job summary

Meta's Applied AI (AAI) team is expanding its Multimedia & MultiModality efforts to develop end-to-end data pipelines and evaluation metrics across image, video, audio, and speech modalities. You will own data production, measurement pipelines, and quality standards beyond your individual work, collaborating with researchers, engineers, and product teams.

You will design scalable workflows, mentor engineers, and drive reproducible evaluation, while advancing state-of-the-art multimodal

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• 6+ years of programming experience in a relevant language or 3+ years of experience + PhD.
• 3+ years building ML systems in production or research settings.
• strong Python and PyTorch
• Demonstrated experience with speech, audio, or music ML - ASR, TTS, audio codecs, music information retrieval, self-supervised audio representation learning, or audio generative modeling
• Experience with large-scale data pipelines and distributed training
• Track record of translating research ideas into working, measurable systems

Responsibilities

• Design and build multimodal agentic workflows and pipelines.
• Design and own data pipelines at scale: ingestion, filtering, pseudo-labeling and captioning with attribute classifiers, and provenance tracking for audio corpora.
• Build evaluation infrastructure: objective metrics, human listening-test pipelines, and correlation analysis.
• Improve training efficiency and reliability — distributed training, GPU utilization, codec and tokenizer retraining, experiment management.
• Reproduce and extend state-of-the-art research in codebases and ablations.
• Mentor engineers on the team, contribute to hiring and onboarding, and raise the bar on evaluation and quality practice.
• Build and train generative and representation models for speech, sound, and music.

Skills

Agentic workflows

Data pipelines

Evaluation infra

Distributed training

SOTA replication

Mentor teammates

Multimodal models

Education

Bachelor's degree in CS/CE or equivalent

Tools

Python

PyTorch

Distributed training

Job description

Meta's Applied AI (AAI) team is expanding its Multimedia & MultiModality efforts to develop end-to-end data pipelines and evaluation metrics across image, video, audio, and speech modalities. You will own data production, measurement pipelines, and quality standards beyond your individual work, collaborating with researchers, engineers, and product teams.

You will design scalable workflows, mentor engineers, and drive reproducible evaluation, while advancing state-of-the-art multimodal