Multimodal AI Engineer: Audio/Video Pipelines

Meta; Topeka (KS); On-site; USD 154,000 - 217,000; Full time

Job summary

Meta’s Applied AI organization invites a Software Engineer, Multimedia & Multimodal AI, to shape data production and measurement across image, video, audio and speech modalities. You will own end-to-end pipelines, from data collection and labeling to evaluation and deployment, enabling scalable, high-quality multimedia models.

The role emphasizes building agentic workflows, improving training efficiency, and reproducing leading research, with opportunities to mentor others and influence hiring

Qualifications

• 3+ years building ML systems in production or research settings.
• strong Python and PyTorch
• Demonstrated experience with speech, audio, or music ML - ASR, TTS, audio codecs, music information retrieval, self-supervised audio representation learning, or audio generative modeling
• Experience with large-scale data pipelines and distributed training
• Track record of translating research ideas into working, measurable systems

Responsibilities

• Design and build agentic workflows and pipelines, including human-in-the-loop and expert-in-the-loop designs, to automate data production and scale output past what manual authoring supports.
• Design and own data pipelines at scale: ingestion, filtering, pseudo-labeling and captioning with attribute classifiers, and provenance tracking for audio corpora.
• Build evaluation infrastructure: objective metrics (speaker/style similarity, codec and generator quality), human listening-test pipelines, and the correlation analysis that ties the two together.
• Improve training efficiency and reliability — distributed training, GPU utilization, codec and tokenizer retraining, experiment management.
• Reproduce and extend state-of-the-art research: implement new methods from papers into our codebases and run rigorous ablations.
• Mentor engineers on the team, contribute to hiring and onboarding, and raise the bar on evaluation and quality practice.
• Build and train generative and representation models for speech, sound, and music — including text-, audio-, and video-conditioned generation, infilling, editing, and style transfer.

Skills

Python

PyTorch

Speech/Audio ML

Distributed training

Data pipelines

Research to production

Job description

Meta’s Applied AI organization invites a Software Engineer, Multimedia & Multimodal AI, to shape data production and measurement across image, video, audio and speech modalities. You will own end-to-end pipelines, from data collection and labeling to evaluation and deployment, enabling scalable, high-quality multimedia models.

The role emphasizes building agentic workflows, improving training efficiency, and reproducing leading research, with opportunities to mentor others and influence hiring