Real-Time Multimodal AI Researcher

Rozgoo; United States; Hybrid; USD 150,000 - 230,000; Full time

Benefits offered by this job

Full health benefits

401k matching

Equity

Hybrid work model

Job summary

Pika seeks a Multimodal LLM Researcher to push the boundaries of real-time, multimodal AI across text, image, video, and audio. You will design novel architectures, distillation methods, and world models, while prototyping agentic systems that power scalable, interactive multimedia experiences.

You will collaborate with engineering and product teams, publish in top venues, and contribute to production-ready technologies. This is a hybrid role with HQ in Palo Alto, CA.

Qualifications

• 5+ years of research in LLM/ multimodal models (LLM, VLM, Audio LM) in academia or industry.
• First-author publications in top conferences/journals (e.g., NeurIPS, CVPR, ICML, ICCV, SIGGRAPH, Interspeech).
• Deep expertise in LLM, VLM, or Audio LM.
• Experience with autoregressive and diffusion models for real-time deployment.
• Hands-on experience curating and building large multimodal datasets.
• Experience deploying real-time systems and agentic orchestration infra.

Responsibilities

• Lead research on real-time multimodal generation (text, image, video, audio) and orchestration of agentic platforms.
• Design and prototype novel algorithms for high-fidelity multimodal synthesis and interactive experiences.
• Focus on real-time model inference across modalities.
• Work on diffusion model distillation and diffusion-based world models for multimodal apps.
• Train and finetune models (LLM, VLM, Audio LM) for real-time performance.
• Curate datasets for video, audio, cross-modal data.
• Collaborate with engineering/product to productionize research advancements.
• Publish results in top venues and communicate internally/externally.

Skills

Strong programming & prototyping

Research in LLM/VLM/Audio LM

Real-time systems development

Excellent communication & teamwork

Dataset curation & multimodal data

Python programming

PyTorch proficiency

TensorFlow proficiency

Education

PhD or MS in a relevant field

Tools

Python

PyTorch

TensorFlow

Job description

Pika seeks a Multimodal LLM Researcher to push the boundaries of real-time, multimodal AI across text, image, video, and audio. You will design novel architectures, distillation methods, and world models, while prototyping agentic systems that power scalable, interactive multimedia experiences.

You will collaborate with engineering and product teams, publish in top venues, and contribute to production-ready technologies. This is a hybrid role with HQ in Palo Alto, CA.