Multimodal AI Engineer - Audio, Video & Speech Systems

Meta; Dover (DE); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta's Applied AI (AAI) organization is seeking a senior software engineer for Multimedia & Multimodal AI to shape data production, measurement pipelines, and evaluation standards across image, video, audio, and speech modalities. You will own data and evaluations that feed model inputs and outputs, collaborating with research, model-training and engineering partners.

You will drive pipeline design, scale data ingestion and labeling, mentor team members, and promote responsible AI practices to

Qualifications

• Bachelor's degree or equivalent practical experience in CS/Engineering.
• 6+ years programming in a relevant language or 3+ years with PhD.
• 3+ years building ML systems in production or research.
• Strong Python and PyTorch skills.
• Experience with speech/audio/music ML (ASR, TTS, codecs, music IR, diffusion etc).
• Experience with large-scale data pipelines and distributed training.
• Proven ability to translate research ideas into working systems.

Responsibilities

• Design and build multimodal agentic workflows and data pipelines with human-in-the-loop elements.
• Build data pipelines at scale: ingestion, filtering, pseudo-labeling, captioning, provenance tracking.
• Create evaluation infrastructure: objective metrics, human listening tests, correlation analysis.
• Improve training efficiency through distributed training and resource optimization.
• Reproduce and extend state-of-the-art research by implementing methods from papers.
• Mentor engineers, aid hiring and onboarding, raise evaluation standards.
• Build and train generative and representation models for speech, audio, and music, including generation and style transfer.

Skills

Python

PyTorch

ML systems

Speech audio music ML

Distributed training

Large-scale data pipelines

Research to product

Education

Bachelor's degree in CS/Engineering or equivalent

Job description

Meta's Applied AI (AAI) organization is seeking a senior software engineer for Multimedia & Multimodal AI to shape data production, measurement pipelines, and evaluation standards across image, video, audio, and speech modalities. You will own data and evaluations that feed model inputs and outputs, collaborating with research, model-training and engineering partners.

You will drive pipeline design, scale data ingestion and labeling, mentor team members, and promote responsible AI practices to