Multimodal AI Engineer: Pipelines, Evaluation & Synthesis

Meta; Indianapolis (IN); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta’s Applied AI (AAI) unit seeks a senior software engineer to lead multimodal data production and evaluation across image, video, audio and speech. You will own end-to-end pipelines, from data collection to measurable metrics, and influence many teams beyond your immediate work.

You will partner with research, model-training and engineering teams to define standards, scale experiments, and raise quality while mentoring peers. This role emphasizes responsible AI and cross-modal experimentation.

Qualifications

• Bachelor’s degree in CS/CE or equivalent practical experience.
• 6+ years of programming experience or 3+ years with a PhD.
• 3+ years building ML systems in production or research settings.
• Strong Python and PyTorch.
• Experience with speech, audio, or music ML (ASR/TTS, codecs, etc.).
• Experience with large-scale data pipelines and distributed training.
• Track record translating research ideas into working systems.

Responsibilities

• Design and build agentic workflows and pipelines, including human-in-the-loop and expert-in-the-loop designs.
• Design and own data pipelines at scale: ingestion, filtering, pseudo-labeling and captioning with attribute classifiers, provenance tracking.
• Build evaluation infrastructure: metrics, listening-test pipelines, and correlation analyses.
• Improve training efficiency and reliability: distributed training, GPU utilization, codec/tokenizer retraining.
• Reproduce and extend state-of-the-art research by implementing papers into code and running ablations.
• Mentor engineers, contribute to hiring/onboarding, raise the bar on evaluation and quality.
• Build and train generative and representation models for speech, sound, and music.

Skills

Python

PyTorch

Distributed training

Data pipelines

ML systems

Research translation

Leadership mentoring

Education

Bachelor's degree in Computer Science/Engineering or equivalent

PhD (optional)

Job description

Meta’s Applied AI (AAI) unit seeks a senior software engineer to lead multimodal data production and evaluation across image, video, audio and speech. You will own end-to-end pipelines, from data collection to measurable metrics, and influence many teams beyond your immediate work.

You will partner with research, model-training and engineering teams to define standards, scale experiments, and raise quality while mentoring peers. This role emphasizes responsible AI and cross-modal experimentation.