Senior Multimodal AI Engineer - Pipelines & Evaluation

Meta; Juneau (AK); On-site; USD 184,000 - 257,000; Full time

Job summary

Meta is hiring a senior engineer for Applied AI's Multimedia & Multimodal team to own end-to-end data production, evaluation pipelines, and model development for speech, audio, and music modalities.

You will set direction for a modality, build scalable data workflows, and mentor engineers while advancing state-of-the-art multimodal research. This role requires leadership across research, model-training, and engineering teams.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or equivalent practical experience.
• 8+ years of programming experience in a relevant language OR 4+ years with a PhD
• 3+ years building ML systems in production or research settings
• Strong Python and PyTorch
• Experience with speech, audio, or music ML — ASR, TTS, audio codecs, music IR, self-supervised audio representation learning, or audio generative modeling
• Experience with large-scale data pipelines and distributed training
• Track record of translating research ideas into working, measurable systems

Responsibilities

• Set technical direction for a modality or capability area.
• Determine investments, define success, and tradeoffs.
• Drive direction across partner teams, not just inside your own.
• Design and build agentic workflows and pipelines with human-in-the-loop designs.
• Design and own data pipelines at scale: ingestion, filtering, pseudo-labeling and captioning with attribute classifiers, provenance tracking for audio corpora.
• Build evaluation infrastructure: objective metrics, human listening-test pipelines, and correlation analysis.
• Improve training efficiency and reliability — distributed training and GPU utilization.
• Reproduce and extend state-of-the-art research by implementing methods from papers.
• Mentor engineers, contribute to hiring and onboarding, raise bar on evaluation and quality.
• Build and train generative and representation models for speech, sound, and music, including text-, audio-, and video-conditioned generation.

Skills

Python

PyTorch

Multimodal ML

Distributed Training

Data Pipelines

MLOps

Education

Bachelor's degree in Computer Science

Job description

Meta is hiring a senior engineer for Applied AI's Multimedia & Multimodal team to own end-to-end data production, evaluation pipelines, and model development for speech, audio, and music modalities.

You will set direction for a modality, build scalable data workflows, and mentor engineers while advancing state-of-the-art multimodal research. This role requires leadership across research, model-training, and engineering teams.