Research Scientist, Video Foundation Models Research - California - Full Time

Cantina, Inc.; California; On-site; USD 200,000 - 320,000; Full time

Benefits offered by this job

Equity

Medical, dental, and vision insurance

PTO & holidays (42 days)

Parental leave

401(k)

Lifestyle spending account

Free lunch & snacks

One Medical membership

Job summary

Cantina Labs seeks a research-focused engineer to help build next-generation native video and multimodal foundation models. You will contribute across architecture, data, training, evaluation, and deployment, shaping technical direction from an early stage.

Ideal candidates have strong research experience in generative modeling, hands-on work with large-scale video or multimodal models, and a track record of impactful work through publications or open-source contributions.

Qualifications

• Strong research and engineering experience in generative modeling, including diffusion models, flow matching, DiTs, video generation, multimodal models, or related fields.
• Hands-on experience training and evaluating large-scale image, video, or unified multimodal models using modern deep learning frameworks and distributed training systems.
• Proven track record of developing impactful models or systems demonstrated through research publications, open-source contributions, production impact, or other significant work.
• Ability to independently own ambiguous research problems and move from ideas to experiments in a collaborative environment.
• Specialized depth in one or more areas across the foundation model lifecycle (architecture, data curation, post-training, deployment, etc.).

Responsibilities

• Research, develop, and scale native video and multimodal foundation models from prototypes to large-scale pre-training.
• Explore new architectures, objectives, and conditioning for video generation and multimodal interaction.
• Build data curation, distributed training, evaluation, and post-training pipelines for high-quality generation.
• Design experiments to understand scaling, generation quality, controllability, and inference efficiency.
• Collaborate with researchers, engineers, and product teams to shape roadmap and translate advances into capabilities.
• Contribute to research publications and open-source releases when appropriate.

Skills

Generative modeling

Video generation

Multimodal models

Distributed training

Research publications

Collaborative work

Model architecture

Job description

Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning.

If you're excited about the potential AI has to shape human creativity and social interactions, join us in building the future!

About the role

We are building a core team to develop next-generation native video and omni foundation models for multimodal generation and understanding. Our current focus is large-scale video foundation model development, spanning pre-training, continued training, and post-training for high-quality, controllable, consistent, and efficient generation. Our broader roadmap includes reference- and memory-based generation, multimodal understanding and interaction, and joint audio-video generation.

In this role, you will work on foundational research and large-scale model development across the full model lifecycle, including architecture, data, training, evaluation, post-training, training systems, and efficient inference. You will have the opportunity to shape both the technical direction and the team from an early stage.

What you'll do

• Research, develop, and scale native video and multimodal foundation models, from early prototypes through large-scale pre-training, continued training, and post-training.
• Explore new model architectures, training objectives, and conditioning mechanisms for video generation, reference- and memory-based generation, multimodal interaction, and joint audio-video generation.
• Build and improve large-scale data curation, distributed training, evaluation, and post-training pipelines for high-quality and controllable generation.
• Design systematic experiments to understand model scaling, generation quality, controllability, consistency, robustness, and inference efficiency.
• Collaborate closely with researchers, engineers, and product teams to help shape the technical roadmap and, where appropriate, translate model advances into real-world capabilities.
• Contribute to research publications and open-source releases when appropriate.

What you'll bring

• Strong research and engineering experience in generative modeling, including areas such as diffusion models, flow matching, DiTs, video generation, multimodal models, world models, or related fields.
• Hands-on experience training and evaluating large-scale image, video, or unified multimodal models using modern deep learning frameworks and distributed training systems.
• A strong track record of developing impactful models or systems, demonstrated through research publications, open-source contributions, production impact, or other significant technical work.
• Ability to independently own ambiguous research problems, move effectively from ideas to experiments, and work well in a highly collaborative environment.
• Specialized depth in one or more areas across the foundation model lifecycle, such as model architecture, data curation, controllable generation, multimodal understanding and conditioning, post-training and reward modeling, model acceleration, inference systems, or deployment.

Compensation

The anticipated annual base salary range for this role is between $200,000-$320,000. When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

• Competitive salary and generous company equity
• Medical, dental, and vision insurance - 99.99% of premiums covered by Cantina
• 42 days of paid time off, including:
  • 15 PTO days
  • 10 sick days
  • 15 company holidays
  • 2 floating holidays
• Generous parental leave & fertility support
• 401(k) retirement savings plan
• Lifestyle spending account - $500/month to use however you’d like
• Complimentary lunch and snacks for in-office employees
• One Medical membership, and more!