Research Scientist, Multi-Modal Understanding & Synthesis

Meta; Pittsburgh, Redmond (Allegheny County, WA); On-site; USD 180,000 - 300,000; Full time

Job summary

Meta is seeking a Research Scientist to advance foundational research in multi-modal understanding, synthesis, and world models. The role focuses on building AI systems that perceive, reason, and generate content across vision, language, audio, and other modalities.

You will lead research initiatives, publish in top venues, and collaborate with engineers to translate breakthroughs into Meta's next-generation AI products.

Qualifications

• PhD in ML, CV, NLP or related field, or equivalent practical experience.
• 6+ years conducting AI research in multi-modal learning or world models.
• Experience leading research initiatives from conception to publication or deployment.
• Proficiency in Python and deep learning frameworks (PyTorch/TensorFlow).
• Strong publication record in top ML/AI venues.

Responsibilities

• Lead foundational research in multi-modal understanding, synthesis, and world models.
• Develop and evaluate large-scale multi-modal systems and models.
• Publish influential work and present findings to diverse audiences.
• Collaborate with research and engineering teams to deploy breakthroughs.

Skills

Multi-modal learning

World models

Deep learning

Python

PyTorch

TensorFlow

Research leadership

Publications

Cross-functional comms

Model-based RL

Education

PhD in ML / CV / NLP

Bachelor's in CS/EE or equivalent

Tools

PyTorch

TensorFlow

Job description

Meta is seeking a Research Scientist to drive foundational research in multi-modal understanding, synthesis, and world models. In this role, you will advance the state of the art in building AI systems that perceive, reason across, and generate content spanning vision, language, audio, and other modalities. You will develop world models that learn rich internal representations of human behavior, enabling prediction, planning, and simulation. Collaborating with world-class researchers and engineers, you will define research directions, publish influential work, and translate breakthroughs into technologies that power Meta's next-generation AI products.

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
• PhD in Machine Learning, Computer Vision, Natural Language Processing, or a closely related field
• 6+ years of experience conducting AI research in multi-modal learning, generative models, or world models, including experience leading major research initiatives from conception through publication or production deployment
• Experience implementing and evaluating multi-modal systems using deep learning frameworks such as PyTorch or TensorFlow, with proficiency in Python
• Experience publishing original research in peer-reviewed machine learning or AI venues
• Experience driving cross-functional technical decisions and communicating research findings and trade-offs to both research and engineering audiences through written documents and presentations
• Experience with techniques spanning multiple modalities such as vision-language models, multi-modal transformers, or cross-modal representation learning
• Experience developing large-scale multi-modal foundation models or vision-language models
• Experience with world models, predictive learning, or model-based reinforcement learning for planning and reasoning
• First-author publications at top-tier venues such as NeurIPS, ICLR, or CVPR demonstrating contributions to multi-modal learning, generative models, or world models