Research Scientist, Multimodal Interaction & World Models

ByteDance; San Jose (CA); On-site; USD 244,800 - 450,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) savings plan with company match

Paid parental leave

Paid holidays and sick days

Job summary

ByteDance in San Jose seeks a PhD candidate to join the Seed Multimodal Interaction team, focused on developing innovative multimodal models that integrate vision, language, and more.

The successful candidate will work on improving decision-making and reasoning capabilities in AI systems, contributing to pioneering advancements in artificial intelligence.

ByteDance offers competitive compensation and a collaborative work environment where creativity flourishes.

Qualifications

• PhD candidates must have an expected graduation date by the end of 2027.
• Familiarity with large-scale model training or simulation environments is required.

Responsibilities

• Develop multimodal foundation models integrating vision, language, audio, and environment signals.
• Design and optimize world models for reasoning, planning, and interaction.
• Improve agent capabilities such as perception, memory, and decision-making.

Skills

Excellent coding ability, data structures, and algorithm skills

Proficient in C/C++ or Python

Experience in multimodal learning

Strong problem-solving and collaboration skills

Education

Currently pursuing a PhD in a relevant field

Job description

ByteDance in San Jose seeks a PhD candidate to join the Seed Multimodal Interaction team, focused on developing innovative multimodal models that integrate vision, language, and more.

The successful candidate will work on improving decision-making and reasoning capabilities in AI systems, contributing to pioneering advancements in artificial intelligence.

ByteDance offers competitive compensation and a collaborative work environment where creativity flourishes.