Senior Multimodal AI Engineer - Video, Audio & Speech

Meta; Lansing (MI); On-site; USD 184,000 - 257,000; Full time

Job summary

Meta’s Applied AI group seeks a senior engineer to lead multimodal data and evaluation pipelines across image, video, audio, and speech modalities. You will determine what data to produce, how to measure it, and drive end-to-end projects from concept to scalable pipelines.

You will work across research, model-training, and engineering, setting standards and raising quality without becoming a bottleneck. Expect collaboration with partners and leadership in this growing area.

Qualifications

• Bachelor's degree or equivalent practical experience in a relevant field.
• 8+ years of programming experience in a relevant language or 4+ years with a PhD.
• 3+ years building ML systems in production or research settings.
• Strong Python and PyTorch.
• Experience with speech, audio, or music ML (ASR, TTS, codecs, MUSIC IR, etc).
• Experience with large-scale data pipelines and distributed training.
• Track record of translating research ideas into working, measurable systems.

Responsibilities

• Set technical direction for a modality or capability area.
• Determine where the team invests and define success metrics.
• Drive direction across partner teams, not just within the group.
• Design and build agentic workflows and pipelines with human/expert-in-the-loop.
• Own data pipelines: ingestion, filtering, pseudo-labeling, captioning, provenance tracking.
• Build evaluation infra: metrics, listening tests, and correlation analyses.
• Improve training efficiency and reliability: distributed training, GPU utilization, retraining.
• Reproduce and extend state-of-the-art research by implementing new methods and conducting ablations.
• Mentor engineers, contribute to hiring and onboarding, elevate evaluation and quality standards.
• Build/train generative and representation models for speech, sound, and music including cross-modal generation.

Skills

Python

PyTorch

ML Systems in Production

Large-scale Data Pipelines

Distributed Training

Research to Production Translation

Multimodal AI

Speech/Audio/Music ML

Education

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

8+ years programming experience

4+ years with PhD

Job description

Meta’s Applied AI group seeks a senior engineer to lead multimodal data and evaluation pipelines across image, video, audio, and speech modalities. You will determine what data to produce, how to measure it, and drive end-to-end projects from concept to scalable pipelines.

You will work across research, model-training, and engineering, setting standards and raising quality without becoming a bottleneck. Expect collaboration with partners and leadership in this growing area.