Research Engineer, Multimodal

character; Redwood City (CA); On-site; USD 100,000 - 150,000; Full time

Job summary

Character is seeking a Research Engineer for the Multimodal team to enhance video and image generation models. The successful candidate will lead efforts in training video models while collaborating with diverse teams to innovate AI visuals.

The role requires strong knowledge in PyTorch and visual AI architectures. Join us in pushing the boundaries of AI-generated visual content!

Qualifications

• Experience with audio, vision, and language modalities training.
• Solid understanding of latest video generation models.
• Hands-on approach to complex technical problem solving.

Responsibilities

• Lead training of video generation models and joint audio-visual generation.
• Design novel model architectures for multimodal generation.
• Build large-scale data pipelines for model improvements.

Skills

Proficient in PyTorch

Experience with multimodal model training

Understanding of video/image generation architectures

Strong passion for visual AI

Tools

Distributed training tools (FSDP, DeepSpeed)

Cloud platforms

Job description

About the Role and Team

Joining us as a Research Engineer on the Multimodal team, you'll be at the forefront of building and advancing video and image generation models that bring AI characters to life in entirely new ways. Your work will directly shape how millions of users experience rich, expressive, and visually compelling AI interactions every day.

The Multimodal team is responsible for training, fine‑tuning, and deploying cutting‑edge image, audio and video generation models that power Character.AI's visual experiences. We work across the full model lifecycle — from data pipelines and training to deployment and product integration.

As a Multimodal Research Engineer, you will own and advance our video model training efforts, including joint audio‑visual generation and image‑to‑video. You will collaborate across research, product, and infrastructure to push the boundaries of what AI‑generated visuals can look and feel like at scale.

What You'll Do

• Lead fine‑tuning and continued training of video generation models, including image‑to‑video and joint audio‑visual generation.
• Design and experiment with novel model architectures for multimodal generation, including multimodal conditioning (voice, structured text, reference images).
• Leverage techniques such as LoRA, RLHF, and full‑parameter fine‑tuning to improve model quality across diverse visual scenarios.
• Design and build large‑scale data pipelines and automated annotation workflows to support continuous model improvement.
• Explore model compression, inference acceleration, and serving optimizations to enable efficient real‑time video processing at scale.

Who You Are

• Strong passion for pushing the boundaries of visual AI, with a self‑driven, hands‑on approach to solving complex technical problems.
• Proficient in PyTorch with end‑to‑end experience across data processing, model training, and deployment.
• Solid understanding of video and image generation architectures, including diffusion models, DiT, ControlNet, and SOTA video generation models.
• Experience with multimodal model training, including working with audio, vision, and language modalities together.
• Experience with distributed training tools (FSDP, DeepSpeed, etc.).
• Experience with large‑scale data processing, dataset construction, and automated data cleaning.

Nice to Have

• Experience with joint audio‑visual or speech‑conditioned generation models.
• Experience with AIGC, video effects, character animation, or asset generation products.
• Familiarity with ML deployment and orchestration (Kubernetes, Slurm, Docker, cloud platforms).
• Publications in relevant venues (NeurIPS, ICLR, CVPR, ECCV, ICCV, or similar).

At Character, we value diversity and welcome applicants from all backgrounds. As an equal opportunity employer, we firmly uphold a non‑discrimination policy based on race, religion, national origin, gender, sexual orientation, age, veteran status, or disability. Your unique perspectives are vital to our success.