Multimodal AI Engineer: Audio & Video Pipelines

Meta; Hartford (CT); On-site; USD 154,000 - 217,000; Full time

Benefits offered by this job

Bonus potential

Equity

Benefits package

Job summary

Meta's Applied AI (AAI) organization, Multimedia & MultiModality team, seeks a senior engineer to own data and evaluation for multimodal models (image, video, audio). You will design end-to-end pipelines and set quality standards for inputs and outputs across modalities.

You will collaborate with research, model-training and engineering partners, mentor engineers and help expand capabilities in speech, audio, and music modalities with measurable impact.

Qualifications

• Bachelor’s degree or equivalent in CS/Engineering or related field.
• 6+ years programming in a relevant language or 3+ years plus PhD.
• 3+ years building ML systems in production or research settings.
• Strong Python and PyTorch experience.
• Experience with speech, audio, or music ML.
• Experience with large-scale data pipelines and distributed training.
• Proven ability to translate research ideas into working systems.

Responsibilities

• Design and build agentic workflows and pipelines with human-in-the-loop designs.
• Design and own data pipelines at scale: ingestion, filtering, pseudo-labeling and captioning with attribute classifiers.
• Build evaluation infrastructure: objective metrics, listening-test pipelines, and correlation analyses.
• Improve training efficiency and reliability — distributed training and resource optimization.
• Reproduce and extend state‑of‑the‑art research by implementing papers into codebases.
• Mentor engineers, contribute to hiring and onboarding, raise evaluation standards.
• Build and train generative and representation models for speech, sound, and music.

Skills

Python

PyTorch

Distributed training

ML systems in production

Speech/audio/music ML

Large-scale data pipelines

Research to production translation

Education

Bachelor's degree in Computer Science/Engineering or equivalent

PhD in a relevant field

Tools

Git

Docker

Distributed training frameworks

Job description

Meta's Applied AI (AAI) organization, Multimedia & MultiModality team, seeks a senior engineer to own data and evaluation for multimodal models (image, video, audio). You will design end-to-end pipelines and set quality standards for inputs and outputs across modalities.

You will collaborate with research, model-training and engineering partners, mentor engineers and help expand capabilities in speech, audio, and music modalities with measurable impact.