Multimodal AI Engineer: Build Media Pipelines

Meta; Santa Fe (NM); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta Applied AI (AAI) seeks a software engineer to own data and evaluation pipelines across image, video, audio, and speech. You will drive multimodal data decisions from questions to scalable pipelines and metrics.

You will design and own data pipelines, reproduce state-of-the-art methods, and mentor engineers while raising evaluation quality. Collaboration with researchers and engineers is central to this role.

Qualifications

• 3 years building ML systems in production or research settings.
• Strong Python and PyTorch.
• Experience with speech, audio, or music ML (ASR, TTS, audio codecs, music information retrieval, etc.).
• Experience with large-scale data pipelines and distributed training.
• Track record translating research ideas into working, measurable systems.

Responsibilities

• Design and build agentic workflows and pipelines, including human-in-the-loop and expert-in-the-loop designs, to automate data production and scale output past what manual authoring supports.
• Design and own data pipelines at scale: ingestion, filtering, pseudo-labeling and captioning with attribute classifiers, and provenance tracking for audio corpora.
• Build evaluation infrastructure: objective metrics (speaker/style similarity, codec and generator quality), human listening-test pipelines, and the correlation analysis that ties the two together.
• Improve training efficiency and reliability — distributed training, GPU utilization, codec and tokenizer retraining, experiment management.
• Reproduce and extend state-of-the-art research: implement new methods from papers into our codebases and run rigorous ablations.
• Mentor engineers on the team, contribute to hiring and onboarding, and raise the bar on evaluation and quality practice.
• Build and train generative and representation models for speech, sound, and music — including text-, audio-, and video-conditioned generation, infilling, editing, and style transfer.

Skills

Python

PyTorch

ML systems

Speech/Audio ML

Data pipelines

Distributed training

Research to production

Job description

Meta Applied AI (AAI) seeks a software engineer to own data and evaluation pipelines across image, video, audio, and speech. You will drive multimodal data decisions from questions to scalable pipelines and metrics.

You will design and own data pipelines, reproduce state-of-the-art methods, and mentor engineers while raising evaluation quality. Collaboration with researchers and engineers is central to this role.