Senior Multimodal AI Engineer: Media, Speech & Video

Meta; Salem (OR); On-site; USD 184,000 - 257,000; Full time

Job summary

Meta's Applied AI (AAI) team is hiring a senior engineer to lead multimodal data production, evaluation, and pipeline development across image, video, audio, and speech modalities. You will own data generation, measurement, and quality standards, collaborating with research, model-training and engineering partners.

You will mentor engineers, help hire, and advance evaluation practices while integrating cutting-edge speech, audio, and music AI into scalable systems.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or related field; equivalent practical experience.
• 8+ years programming OR 4+ years with a PhD.
• 3+ years building ML systems in production or research.
• Strong Python and PyTorch proficiency.
• Experience with speech, audio, or music ML (ASR, TTS, codecs, music info retrieval, etc.).
• Experience with large-scale data pipelines and distributed training.
• Track record translating research ideas into measurable systems.

Responsibilities

• Lead modality or capability area direction and define data to produce and measure.
• Drive cross-functional alignment across partner teams.
• Design and build agentic workflows and pipelines with human-in-the-loop elements.
• Own data pipelines: ingestion, filtering, pseudo-labeling, captioning, provenance tracking.
• Build evaluation infrastructure: objective metrics and human listening tests.
• Improve training efficiency: distributed training, GPU utilization, tokenizer retraining.
• Reproduce and extend state-of-the-art research via code and ablations.
• Mentor engineers, contribute to hiring and onboarding, raise quality standards.
• Build and train generative/representation models for speech, sound, and music.

Skills

Python

PyTorch

Distributed training

ML systems

Speech/Audio/Music ML

Data pipelines

Research to production

Mentorship

Education

Bachelor's degree in CS/CE

PhD (optional with 4+ years)

Tools

PyTorch

Distributed training tools

Job description

Meta's Applied AI (AAI) team is hiring a senior engineer to lead multimodal data production, evaluation, and pipeline development across image, video, audio, and speech modalities. You will own data generation, measurement, and quality standards, collaborating with research, model-training and engineering partners.

You will mentor engineers, help hire, and advance evaluation practices while integrating cutting-edge speech, audio, and music AI into scalable systems.