Senior Multimodal AI Engineer - Multimedia & Audio

Meta; Trenton (NJ); On-site; USD 184,000 - 257,000; Full time

Job summary

Meta’s Applied AI organization seeks a senior engineer to lead multimodal data and evaluation work across image, video, audio, and speech modalities. You will own data production pipelines, set standards, and drive impact across partner teams, including bias reduction and responsible AI practices.

The role emphasizes building agentic workflows, scalable data pipelines, and reproducible research, with opportunities to mentor peers and shape future model evaluation standards within the Multimedia

Qualifications

• Bachelor's degree or equivalent practical experience in CS/engineering.
• 8+ years programming in a relevant language OR 4+ years with a PhD.
• 3+ years building ML systems in production or research.
• Strong Python and PyTorch skills.
• Experience with speech, audio, or music ML (ASR, TTS, codecs, MIR, etc).
• Experience with large-scale data pipelines and distributed training.
• Track record translating research ideas into working, measurable systems.

Responsibilities

• Set technical direction for a modality or capability area.
• Determine investment areas, define success metrics, and tradeoffs.
• Drive direction across partner teams beyond own group.
• Design and build agentic workflows and pipelines with human-in-the-loop concepts.
• Own data pipelines: ingestion, filtering, pseudo-labeling, captioning, provenance tracking.
• Build evaluation infrastructure: objective metrics, listening tests, correlation analyses.
• Improve training efficiency and reliability: distributed training, GPU utilization, retraining, experiment mgmt.
• Reproduce and extend state-of-the-art research by implementing methods from papers.
• Mentor engineers, contribute to hiring and onboarding, raise quality standards.
• Build/train generative and representation models for speech, sound, and music with multi-modal capabilities.

Skills

Python

PyTorch

Distributed training

Large-scale data pipelines

ML systems in production

Education

Bachelor's degree in Computer Science/Engineering or equivalent

Job description

Meta’s Applied AI organization seeks a senior engineer to lead multimodal data and evaluation work across image, video, audio, and speech modalities. You will own data production pipelines, set standards, and drive impact across partner teams, including bias reduction and responsible AI practices.

The role emphasizes building agentic workflows, scalable data pipelines, and reproducible research, with opportunities to mentor peers and shape future model evaluation standards within the Multimedia