Research Scientist, World Modeling & Multimodal AI

Ifm Us; Sunnyvale (CA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

Bonus

401k Plan

Paid time off

Parental Leave

EAP

Job summary

Institute of Foundation Models, operating the AllWorld Team at MBZUAI, seeks researchers to develop the PAN world models that simulate physical environments. You will train on large clusters, design benchmarks, and optimize data pipelines for high-quality video data.

The role emphasizes collaboration across engineering and research to push state-of-the-art multimodal AI. Candidate requirements include MSc/PhD in ML or CS, hands-on experience with video generative models, and proficiency in

Qualifications

• PhD or MSc in ML/CS or equivalent industry experience.
• Strong background in ML theory and practice.
• Proven ability to work on cutting-edge AI research.

Responsibilities

• Develop foundational world model to simulate physical world.
• Collaborate with engineering and data teams on large-scale training.
• Create metrics and benchmarks to evaluate model performance.
• Build scalable data annotation pipelines for high-quality data.
• Improve inference efficiency for real-time interaction.
• Advance training systems for multimodal LLMs and video models.
• Develop scalable video data pipelines and annotation frameworks.
• Optimize inference via distillation and efficiency techniques.

Skills

Problem-solving ability

Team collaboration

Effective communication

Advanced research thinking

Education

MSc/PhD in ML or CS

Tools

PyTorch

Job description

Institute of Foundation Models, operating the AllWorld Team at MBZUAI, seeks researchers to develop the PAN world models that simulate physical environments. You will train on large clusters, design benchmarks, and optimize data pipelines for high-quality video data.

The role emphasizes collaboration across engineering and research to push state-of-the-art multimodal AI. Candidate requirements include MSc/PhD in ML or CS, hands-on experience with video generative models, and proficiency in