AI Researcher (Multimodal Audio/Video Generation)

FDE Times

San Francisco (CA)

Hybrid

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Tavus is hiring a Senior AI Researcher to lead research in audio-visual avatar generation. You will push generative models in conversational contexts and translate findings into production alongside Applied ML and engineering.

Ideal candidates have a PhD or equivalent experience with 2–3+ years applying generative models at scale, and a track record of publications in top venues. Strong PyTorch and GPU workflows skills are essential.

Qualifications

  • A PhD or equivalent research experience, plus 2–3+ years of hands‑on experience applying generative models at scale.
  • Expertise in diffusion models and awareness of latest efficiency techniques.
  • Experience in multimodal generation — spanning video, audio, and language.
  • Proven innovation in long-video generation and/or audio generation.
  • Excellent programming skills — fluent in PyTorch and GPU-optimized workflows.
  • Track record of publications in top-tier venues (CVPR, NeurIPS, BMVC, ICASSP, etc.).
  • Experience leading research activities or mentoring teams.

Responsibilities

  • Lead research efforts on audio-visual generation for avatars (Neural Avatars, Talking-Heads) in conversational settings.
  • Design models integrated with conversation flow — capturing/verbal and non-verbal signals.
  • Drive diffusion, long-video, and audio-visual modeling innovations.
  • Translate research into production by partnering with Applied ML and engineering.
  • Mentor researchers, set directions, and publish impactful work.

Skills

PyTorch
GPU-optimized workflows
Mentoring researchers
Publications

Education

PhD or equivalent research experience

Job description

About Us

Tavus is a research lab pioneering human computing. We’re building AI Humans: a new interface that closes the gap between people and machines, free from the friction of today’s systems. Our real-time human simulation models let machines see, hear, respond, and even look real—enabling meaningful, face-to-face conversations. AI Humans combine the emotional intelligence of humans with the reach and reliability of machines, making them capable, trusted agents available 24/7, in every language, on our terms.

Imagine a therapist anyone can afford. A personal trainer that adapts to your schedule. A fleet of medical assistants that can give every patient the attention they need. With Tavus, individuals, enterprises, and developers can all build AI Humans to connect, understand, and act with empathy at scale.

We’re a Series A company backed by world-class investors including Sequoia Capital, Y Combinator, and Scale Venture Partners.

Be part of shaping a future where humans and machines truly understand each other.

The Role

We’re hiring a Senior AI Researcher to lead research in audio-visual avatar generation. This role is for someone who thrives in ambiguity, has a track record of pushing generative models to new frontiers, and wants to define what human–AI interaction looks like in practice.

Your Mission
  • Lead research efforts on audio-visual generation for avatars (Neural Avatars, Talking-Heads), with a focus on conversational settings.
  • Design models that are coupled with conversation flow — capturing and generating verbal + non-verbal signals in sync.
  • Drive innovation in diffusion models, long-video generation, and audio-visual modeling.
  • Translate research into production by partnering with Applied ML and engineering.
  • Mentor researchers, set research directions, and publish impactful work.
You’ll Bring
  • A PhD or equivalent research experience, plus 2–3+ years of hands‑on experience applying generative models at scale.
  • Expertise in diffusion models and awareness of the latest efficiency techniques.
  • Experience in multimodal generation — spanning video, audio, and language.
  • Proven innovation in long-video generation and/or audio generation.
  • Excellent programming skills — fluent in PyTorch and GPU-optimized workflows.
  • Track record of publications in top-tier venues (CVPR, NeurIPS, BMVC, ICASSP, etc.).
  • Experience leading research activities or mentoring teams.
Nice-to-Haves
  • Skills in 3D graphics, Gaussian splatting, or large-scale training setups.
  • Broad exposure to generative AI models beyond your specialty.
  • Familiarity with software development best practices.
Location

Preferred: San Francisco (hybrid) or London.

Remote within U.S. or Europe considered for exceptional candidates.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Multimodal Conversational Research Engineer
Multimodal Conversational Research Engineer

Tavus • United States

Hybrid
USD 100,000 - 150,000
Conversational Modelling Research Engineer
Conversational Modelling Research Engineer

Tavus • San Francisco (CA)

Hybrid
USD 120,000 - 230,000
Senior AI Researcher: Multimodal Audio-Visual Avatars
Senior AI Researcher: Multimodal Audio-Visual Avatars

FDE Times • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
AI/ML Engineer — Generative Video & Avatar AI
AI/ML Engineer — Generative Video & Avatar AI

IntelliPro Group Inc. • Palo Alto (CA)

On-site
USD 160,000 - 200,000
Stock options
Conversational Modelling Research Engineer
Conversational Modelling Research Engineer

Tavus • United States

Hybrid
USD 100,000 - 150,000
AI Engineer
AI Engineer

Embedding VC • Palo Alto (CA)

On-site
USD 140,000 - 230,000
AI Engineer
AI Engineer

LiveX AI, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Competitive salary
Equity
GPU compute access
Embodied AI Research Scientist — Real-Time 3D Synthesis
Embodied AI Research Scientist — Real-Time 3D Synthesis

Thespian Labs • Somerville (MA)

Hybrid
USD 120,000 - 180,000
Visa sponsorship
Equal opportunity employer
Member of Technical Staff, Research
Member of Technical Staff, Research

Odyssey • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Staff AI Researcher
Staff AI Researcher

The Biological Computing Co. • San Francisco (CA)

On-site
USD 260,000 - 350,000