PhD Intern: Multimodal AI & World Modeling

Bytedance

San Jose (CA)

On-site

USD 97,000 - 138,000

Full time

4 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Health insurance
Life insurance
Wellbeing benefits
10 paid holidays per year
Paid sick time
Housing allowance

Job summary

ByteDance Seed team seeks PhD interns to design RL training systems for multimodal foundation models and to develop unified frameworks for audiovisual and language integration. The role emphasizes visual latent reasoning and collaboration with researchers on world modeling and instruction-conditioned generation.

Applicants should be PhD candidates with publications in leading AI/ML venues and a strong RL/multimodal research background, ready to start in the United States under a campus

Qualifications

  • Pursuing a PhD in a related technical discipline.
  • Publications in top AI/ML venues (CVPR, ECCV, ICCV, NeurIPS, ICLR, ICML).
  • Strong research background in RL, multimodal learning, video understanding or vision-language modeling.
  • Must have work authorization in the country of employment at the time of hire.

Responsibilities

  • Design and implement RL training systems for large-scale multimodal models.
  • Develop unified modeling frameworks integrating video, audio, and language for visual latent reasoning.
  • Explore RL-based approaches for multimodal visual reasoning and generation.
  • Collaborate with researchers to evaluate models on world modeling, reasoning, and instruction-conditioned generation.

Skills

Reinforcement learning
Multimodal learning
Video understanding
Vision-language modeling

Education

PhD in Software Development, Computer Science, Computer Engineering or related technical discipline

Job description

ByteDance Seed team seeks PhD interns to design RL training systems for multimodal foundation models and to develop unified frameworks for audiovisual and language integration. The role emphasizes visual latent reasoning and collaboration with researchers on world modeling and instruction-conditioned generation.

Applicants should be PhD candidates with publications in leading AI/ML venues and a strong RL/multimodal research background, ready to start in the United States under a campus

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Scientist, Multimodal & Foundation Models
Research Scientist, Multimodal & Foundation Models

Bytedance • San Jose (CA)

On-site
USD 254,000 - 480,000
Medical/Dental/Vision
401(k) with company match
Paid parental leave
+6
PhD Internship: LLM & Multimodal AI Researcher
PhD Internship: LLM & Multimodal AI Researcher

Bytedance • San Jose (CA)

On-site
USD 97,000 - 138,000
Health insurance
Housing allowance
Graduate Research Scientist — Multimodal AI
Graduate Research Scientist — Multimodal AI

Bytedance • San Jose (CA)

On-site
USD 254,000 - 480,000
PhD Research Intern: AI/ML, RL & Multimodal Vision
PhD Research Intern: AI/ML, RL & Multimodal Vision

Simular Inc. • Palo Alto (CA)

On-site
USD 30,000 - 50,000
PhD Research Intern — Long-Video Generation
PhD Research Intern — Long-Video Generation

Bytedance • San Jose (CA)

On-site
USD 97,000 - 138,000
Health insurance
Paid holidays
Housing allowance
+1
Research Scientist, AI & Audio Gen for Global Impact
Research Scientist, AI & Audio Gen for Global Impact

Bytedance • San Jose (CA)

On-site
USD 254,000 - 480,000
Medical Insurance
Dental Insurance
Vision Insurance
+8
PhD Internship: Multimodal Embodied AI in Dynamic Environments
PhD Internship: Multimodal Embodied AI in Dynamic Environments

Mitsubishi Electric Research Laboratories • Cambridge (MA)

On-site
USD 30,000 - 40,000
Research Scientist Graduate (Multimodal Interaction and World Model) - 2026 Start (PhD)
Research Scientist Graduate (Multimodal Interaction and World Model) - 2026 Start (PhD)

ByteDance • San Jose (CA)

On-site
USD 244,800 - 450,000
Medical, dental, and vision insurance
401(k) with company match
Paid parental leave
+2
PhD Research Intern
PhD Research Intern

Simular Inc. • Palo Alto (CA)

On-site
USD 30,000 - 50,000
Research Scientist, Vision & Multimodal AI
Research Scientist, Vision & Multimodal AI

Bytedance • San Jose (CA)

On-site
USD 254,000 - 480,000
Healthcare benefits
401(k) with match
Paid parental leave
+3