Multimodal AI Engineer — Multimedia Pipelines & Eval

Meta; Augusta (ME); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta's Applied AI (AAI) organization seeks a senior engineer to own data production, measurement pipelines, and multimodal evaluations across image, video, audio, and speech. You will shape what to measure, build end-to-end pipelines, and set standards for quality, with ownership beyond your own work.

You will collaborate across research and engineering, advancing state-of-the-art multimodal models while improving training efficiency and deploying robust data-driven evaluation.

Qualifications

• Bachelor's degree in CS/CE or equivalent practical experience.
• 6+ years programming in a relevant language, or 3+ years with a PhD.
• 3+ years building ML systems in production or research.
• Strong Python and PyTorch.
• Experience with speech, audio, or music ML.
• Experience with large-scale data pipelines and distributed training.
• Track record translating research ideas into working systems.

Responsibilities

• Design and build agentic workflows and pipelines, including human-in-the-loop and expert-in-the-loop designs, to automate data production and scale output past what manual authoring supports.
• Design and own data pipelines at scale: ingestion, filtering, pseudo-labeling and captioning with attribute classifiers, and provenance tracking for audio corpora.
• Build evaluation infrastructure: objective metrics, human listening-test pipelines, and correlation analysis.
• Improve training efficiency and reliability — distributed training, GPU utilization, codec and tokenizer retraining, experiment management.
• Reproduce and extend state‑of‑the‑art research: implement methods from papers into our codebases and run ablations.
• Mentor engineers on the team, contribute to hiring and onboarding, and raise the bar on evaluation and quality practice.
• Build and train generative and representation models for speech, sound, and music.

Skills

Python

PyTorch

Speech/Audio ML

Distributed training

Data pipelines

Multimodal AI

Mentoring

Education

Bachelor's degree in Computer Science, Computer Engineering, or related field

Tools

Git

Linux

Docker

Job description

Meta's Applied AI (AAI) organization seeks a senior engineer to own data production, measurement pipelines, and multimodal evaluations across image, video, audio, and speech. You will shape what to measure, build end-to-end pipelines, and set standards for quality, with ownership beyond your own work.

You will collaborate across research and engineering, advancing state-of-the-art multimodal models while improving training efficiency and deploying robust data-driven evaluation.