Research Scientist – World Modeling, Data

Institute of Foundation Models; Sunnyvale (CA); On-site; USD 150,000 - 400,000; Full time

Benefits offered by this job

Medical benefits

Dental/vision

401K

Paid time off

Parental leave

Employee assistance

Life insurance

Disability

Job summary

The Institute of Foundation Models in Sunnyvale, CA is seeking Research Scientists to tackle the data problems that determine our world model capabilities. You will design, develop, and run state-of-the-art systems for curating, ingesting, filtering, annotating, and training with billion-scale visual data.

You will work on motion scoring, camera control, and video understanding, translating human effort into durable automated systems.

Qualifications

• PhD in Machine Learning or Computer Science, or equivalent industry experience.
• Strong communication and collaboration skills for cross-functional work.
• Experience building and optimizing large-scale video data pipelines.

Responsibilities

• Translate requirements into data work for training systems.
• Design and build scalable data pipelines.
• Collaborate with engineering to scale data pipelines on AWS and in-house clusters.
• Develop state-of-the-art visual understanding systems for labeling and annotating media.

Skills

Data pipeline design

Cross-functional collaboration

Problem solving

Communication skills

Ambiguity navigation

Deep learning systems

Video data understanding

Education

PhD in ML or CS

Tools

PyTorch

Job description

About the Institute of Foundation Models

We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.

As part of our team, you'll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries.Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub forhigh-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AIpioneers.

Position Summary

We are looking for Research Scientists to tackle the data problems thatdetermineour world model capabilities. You will design, develop, and runstate-of-the-artsystems for curating, ingesting, filtering, annotating, and training with billion-scale visual data. You will work on problems including, but not limited to, motion scoring, camera control, and video understanding. You will translate our team’s human efforts into durable automated systems, whose performance is quantitatively verifiable.

$150,000 - $400,000 a year

Key Responsibilities

• Translaterequirements from downstream training,applicationandevalteams to actionable data work.
• Designandbuildscalable data pipelines.
• Collaborate with engineering to scaledatapipelines on AWS infrastructure and in-house clusters.
• Developstate-of-the-artvisual understanding systems to accurately label and annotate images and videos, such as for detecting AI-generated content.

Academic Qualification

• PhD in Machine Learning or Computer Science, or equivalent industry experience.

Professional Experience

Necessary:

• Strong communicationand collaboration skills for effective cross-functional teamwork.
• Ability to navigate ambiguity and drive projects in rapidly evolving research areas.
• Exceptional problem-solving and troubleshooting skills to tackle complex technical challenges.

Preferred:

• Experience inbuilding andoptimizinglarge-scale video data pipelines.
• Experience with large scale video curation.
• Experience with data filtering, particularly AI-generated contentdetectionand duplicate detection.
• Experience with image or video data annotation.
• Experience with video data curriculum.
• Strong systems and engineeringexpertisein deep learning frameworks such asPyTorch.

• Research contributions to top-tier conferences or journals (e.g., ICML, ICLR,NeurIPS, ACL, CVPR, COLM, etc.), with published work in relevant domains.

Visa Sponsorship

This position is eligible for visa sponsorship.

Benefits Include

• Comprehensive medical, dental, and vision benefits
• Bonus
• 401K Plan
• Generous paid time off, sick leave and holidays
• Paid Parental Leave
• Employee Assistance Program
• Life insurance and disability