Research Scientist, Real-Time Video Generation

Cantina Labs

Netherlands

Remote

EUR 90,000 - 140,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive salary
Company equity
Medical, dental, and vision insurance
Generous PTO
Parental leave & fertility support
401(k) retirement savings plan
Lifestyle spending account
In-office lunch and snacks

Job summary

Cantina Labs in the Netherlands is seeking a research-focused engineer to advance real-time video generation for interactive characters. You will develop and fine-tune models that deliver responsive, expressive appearances across identities and styles.

The role emphasizes latency, quality, and reliability, with freedom to propose new approaches, run experiments, and share early results with the team. You will collaborate across data, training, and evaluation to push the boundaries of how speech,

Qualifications

  • Experience training or fine-tuning video or related generative models.
  • Ability to learn unfamiliar methods quickly and turn ideas into experiments.
  • Good experimental judgment, ownership, and clear communication.
  • Freedom to explore new approaches and fast iteration with results.
  • Proactive in sharing findings and collaborating across teams.

Responsibilities

  • Real-time and streaming generation: build models for responsive interaction with stable visuals.
  • Character expression and motion: align appearance, speech, and motion across identities.
  • Fine-tuning and post-training: adapt video models to new data and objectives.
  • Distillation and inference optimization: improve speed and efficiency of generation.
  • Data development: curate and sample training data to cover failures and gaps.
  • Evaluation: compare approaches with qualitative and quantitative assessments.
  • Research and collaboration: read literature, reproduce ideas, share demos and results.

Skills

Video generation
Fine-tuning models
Experimental judgment
Clear communication

Job description

About Cantina

Cantina Labs is a social AI company, developing a suite of advanced real-time models that push the boundaries of expression, personality, and realism. We bring characters to life, transforming how people tell stories, connect, and create. We build and power ecosystems. Cantina, our flagship social AI platform, is just the beginning. If you're excited about the potential AI has to shape human creativity and social interactions, join us in building the future!

About the Role

We’re working on real-time video generation for interactive characters, spanning realistic humans, stylized characters, and non-human identities. We want these characters to feel present: to speak, react, and express themselves through their face, gestures, and body language. This brings together a set of closely connected research problems. A character needs a consistent appearance, expressive and coherent motion, and a natural relationship between speech and movement. The model also needs to respond quickly and keep generating reliably as an interaction unfolds. Quality, controllability, and efficiency all matter. You’ll work across streaming generation, fine-tuning, distillation, inference optimization, and data. Some problems will call for a new training approach; others will come down to better examples, a more useful evaluation, or understanding a bottleneck in the implementation. Part of the job is figuring out which intervention is worth making. You’ll have substantial freedom to propose directions, investigate unfamiliar ideas, and shape what we work on next. We’re looking for someone who enjoys that freedom and can turn it into a steady sequence of useful experiments.

What You’ll Work On
  • Real-time and streaming generation. Develop models that support responsive interaction while maintaining visual quality and consistency over time. Investigate latency, continuity, and how model behavior changes during longer generation.
  • Character expression and motion. Explore how appearance, facial expression, gesture, and body movement come together into a coherent character. Improve the relationship between speech and motion across different identities and visual styles.
  • Fine-tuning and post-training. Adapt video models to new data, behaviors, and capabilities. Investigate training objectives and conditioning methods, and follow promising ideas through implementation and evaluation.
  • Distillation and inference optimization. Make generation faster and more efficient. Work across model-level approaches and runtime improvements, measuring their effects on quality, latency, and memory.
  • Data development. Spend meaningful time with the actual training examples. Identify missing coverage and recurring failure modes, improve curation and sampling, and develop data that helps models learn the behavior we want.
  • Evaluation. Build comparisons that make progress visible and failures understandable. Combine quantitative measurements with careful inspection of generated video and the experience of interacting with the model.
  • Research and collaboration. Read relevant work, reproduce and adapt useful ideas, and share early experiments, demos, and findings. Help the team decide what deserves more time and compute.
What You’ll Bring
  • Experience training or fine-tuning video or related generative models.
  • Ability to learn unfamiliar methods quickly and turn ideas into useful experiments.
  • Good experimental judgment, ownership, and clear communication.
  • You’ll have freedom to explore new approaches.
  • We expect fast iteration and early sharing of results.
Compensation

When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data.

Benefits for U.S.-based roles
  • Competitive salary and generous company equity
  • Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
  • 42 days of paid time off, including:
    • 15 PTO days
    • 10 sick days
    • 15 company holidays
    • 2 floating holidays
  • Generous parental leave & fertility support
  • 401(k) retirement savings plan
  • Lifestyle spending account – $500/month to use however you’d like
  • Complimentary lunch and snacks for in-office employees
  • One Medical membership, and more!
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

TikTok Channel Manager
TikTok Channel Manager

idea.ai • Amsterdam

On-site
EUR 50,000 - 70,000
Lunch provided in office
30 days Work From Anywhere per year
24 days paid vacation per year + hols
+3
AI/LLM Engineer (Model Fine-Tuning & Conversational AI)
AI/LLM Engineer (Model Fine-Tuning & Conversational AI)

Salve.Inno Consulting • Amsterdam

Remote
EUR 70,000 - 110,000
Fully remote (Europe)
B2B contractor agreement
20 paid leave days per year
+6
AI Video Creator & Editor
AI Video Creator & Editor

Arbeitnow • Amsterdam

Hybrid
EUR 60,000 - 90,000
Lunch
Work From Anywhere Benefit
30 days Work From Anywhere per year
+4
TikTok Creator
TikTok Creator

Creative Fabrica • Amsterdam

On-site
EUR 60,000 - 90,000
Lunch & meals in office
Work From Anywhere Benefit
30 days vacation + public holidays
+4
AI Video Creator & Editor
AI Video Creator & Editor

IDEA • Amsterdam

On-site
EUR 70,000 - 110,000
Lunch provided at office
30 days Work From Anywhere per year
24 days paid vacation + publicholidays
+3
Staff AI Engineer - Agentic Shopping
Staff AI Engineer - Agentic Shopping

Picnic • Amsterdam

On-site
EUR 120,000 - 180,000
Health insurance discount
Bike plan
Relocation support
+2
Senior Research Scientist
Senior Research Scientist

adaption • Netherlands

On-site
EUR 100,000 - 150,000
Flexible work
Adaption Passport
Lunch stipend
+1
Social Media Lead / Brand Voice
Social Media Lead / Brand Voice

IDEA • Amsterdam

On-site
EUR 55,000 - 75,000
Lunch provided in office
Work From Anywhere Benefit (30 days)
24 days paid vacation + holidays
+3
Full-Stack Engineer (Backend Leaning) - Creative Agents
Full-Stack Engineer (Backend Leaning) - Creative Agents

ElevenLabs • Nederland

Remote
EUR 70,000 - 110,000
AI Video Creator & Editor
AI Video Creator & Editor

Creative Fabrica • Amsterdam

On-site
EUR 65,000 - 98,000
Lunch provided
30 days Work From Anywhere per year
24 days paid vacation per year
+3