Senior Multimodal AI Engineer: Media, Audio & Vision

Meta; Helena (MT); On-site; USD 184,000 - 257,000; Full time

Job summary

Meta’s Applied AI (AAI) team seeks a senior engineer to own end-to-end multimodal projects, spanning image, video, audio, and speech data and evaluations. You will determine data to produce, design pipelines, and set quality standards across partner teams.

You will mentor engineers, help hire, and drive measurable impact by advancing generative and representation models for speech, sound, and music, including text-, audio-, and video-conditioned generation.

Qualifications

• Bachelor's degree in CS, CE, or related field, or equivalent practical experience.
• 8+ years of programming experience or 4+ years with a PhD.
• 3+ years building ML systems in production or research.
• Strong Python and PyTorch.
• Experience with speech, audio, or music ML (ASR, TTS, codecs, MIR, etc.).
• Experience with large-scale data pipelines and distributed training.
• Track record translating research ideas into working systems.

Responsibilities

• Set technical direction for a modality or capability area.
• Determine where the team invests, what success means, and Tradeoffs behind both.
• Drive that direction across partner teams, not just inside your own.
• Design and build agentic workflows and pipelines, including human-in-the-loop and expert-in-the-loop designs, to automate data production and scale output.
• Design and own data pipelines at scale: ingestion, filtering, pseudo-labeling and captioning with attribute classifiers, and provenance tracking for audio corpora.
• Build evaluation infrastructure: objective metrics, human listening-test pipelines, and correlation analysis.
• Improve training efficiency and reliability — distributed training, GPU utilization, codec and tokenizer retraining, experiment management.
• Reproduce and extend state-of-the-art research: implement new methods from papers into our codebases and run rigorous ablations.
• Mentor engineers on the team, contribute to hiring and onboarding, and raise the bar on evaluation and quality practice.
• Build and train generative and representation models for speech, sound, and music.

Skills

Python

PyTorch

ML Systems

Speech/Audio/Music ML

Distributed Training

Data Pipelines

Research to Production

Education

Bachelor's degree in CS/Engineering

PhD in a relevant field

Job description

Meta’s Applied AI (AAI) team seeks a senior engineer to own end-to-end multimodal projects, spanning image, video, audio, and speech data and evaluations. You will determine data to produce, design pipelines, and set quality standards across partner teams.

You will mentor engineers, help hire, and drive measurable impact by advancing generative and representation models for speech, sound, and music, including text-, audio-, and video-conditioned generation.