Controllable Video Generation Researcher

LightSpeed Studios; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

LightSpeed Studios in Singapore seeks a PhD-level researcher to advance controllable video generation for interactive gaming. You will design multimodal frameworks and pursue high-fidelity results under sparse control signals, collaborating with engine teams to define interfaces for controllable signals.

The role emphasizes research in camera, trajectory, and posture control, real-time performance, and integration with reinforcement learning post-training. Prior game AI experience is a plus.

Qualifications

• PhD in a relevant AI field with strong publication record.
• Proficient in conditional generation models and multi-player/multi-channel control technologies.
• Familiar with diffusion model principles.

Responsibilities

• Design a multimodal controllable generation framework for inputs like keyboard, controller, trajectory and voice.
• Research high-fidelity generation with sparse control signals; extend conditional control paradigms in video.
• Decouple and integrate trajectory, camera, motion, and posture controls.
• Develop dedicated control modules for different game genres.
• Build video generation capabilities for multi-player collaboration with low latency.
• Collaborate with Engine/Agent teams to define standardized interfaces for controllable signals.
• Drive joint optimization of controllable generation and RL post-training.

Skills

PhD in AI/Computer Vision

Conditional generation & diffusion

Multichannel control & gameplay

Camera/trajectory/posture control

Engine I/O & frame sync

Python/PyTorch publications

Real-time video generation

Game AI / game development

Education

PhD in AI/Computer Vision/Deep Learning

Tools

Python/PyTorch

Job description

Overview

LIGHTSPEED STUDIOS is a leading global game developer focused on advancing the art and science of game development through compelling stories, gameplay, and technology. We pursue next‑generation experiences for gamers across multiple genres and devices.

Role Responsibilities

• Design a multimodal controllable generation framework supporting inputs such as keyboard, controller, trajectory, and voice.
• Research high‑fidelity generation under sparse control signals and extend conditional control paradigms in the video domain.
• Decouple and combine trajectory control, camera control, motion control, and posture control.
• Design dedicated control modules tailored to different game genres.
• Develop video generation capabilities for multi‑player collaborative control with low latency and inter‑frame state retention.
• Collaborate with Engine/Agent teams to define standardized interfaces for controllable signals.
• Drive joint optimization of controllable generation and Reinforcement Learning post‑training.

Qualifications

• Ph.D. in AI‑related fields, focusing on Computer Vision/Deep Learning.
• Proficient in conditional generation models and multi‑player/multi‑channel control technologies; familiar with diffusion model principles.
• Project experience in camera control, trajectory control, or posture control.
• Understanding of game engine input/output logic and frame synchronization mechanisms.
• Proficient in Python/PyTorch, with publications in controllable video generation or conditional generation.
• Experience in Game AI or game development is preferred; experience in real‑time/interactive video generation projects is preferred.

Employment Information

Equal Employment Opportunity at Tencent. As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.

About LIGHTSPEED STUDIOS

LIGHTSPEED STUDIOS is a leading global game developer with teams across China, the United States, Singapore, Canada, United Kingdom, France, Japan, South Korea, New Zealand, and the United Arab Emirates. The studio has created over 50 games across multiple platforms and genres for more than four billion registered users. It is the co‑developer of the worldwide hit PUBG MOBILE (co‑developed with KRAFTON, Inc.).