Controllable Video Generation Researcher

L&Q OASIS PTE. LTD.; Singapore; On-site; SGD 120,000 - 160,000; Full time

Job summary

Tencent's Lightspeed Studios research team seeks a PhD-level AI researcher to design multimodal controllable video generation systems. You will explore conditional control, diffusion-based methods, and low-latency inter-frame strategies for collaborative play across game genres.

Collaboration with engine teams and RL post-training will be essential for production-ready results. Applicants should have a PhD in AI-related fields, strong Python/PyTorch skills, and publications in controllable video

Qualifications

• Ph.D. in AI-related fields with focus on CV/Deep Learning.
• Proficient in conditional generation models and multi-player control technologies; familiar with diffusion models.
• Experience in real-time/interactive video generation or game AI is preferred.

Responsibilities

• Design a multimodal controllable generation framework for various inputs (keyboard, controller, trajectory, voice).
• Research high-fidelity generation under sparse control signals and extend conditional control paradigms in video.
• Collaborate with Engine/Agent teams to define standardized interfaces and drive joint optimization with RL after training.

Skills

Python/PyTorch

Multimodal control

Diffusion models

Reinforcement Learning

Education

PhD in AI/Computer Vision

Job description

Business Unit LIGHTSPEED STUDIOS is made up of passionate players who advance the art & science of game development through great stories, great gameplay, and advanced technology. We are focused on bringing next generation experiences to gamers who want to enjoy them anywhere, anytime, across multiple genres and devices.

About the Hiring Team

Lightspeed Tech Center is a R&D department under Lightspeed Studios which develop PUBG Mobile and other high-quality games. Our Tech Center leads the research, exploration, and discovery of innovative technologies and provides technical services for all games during all phases of life cycle, including engine, audio, QA, AI, next generation game, technical cooperation, etc.

What the Role Entails

Design a multimodal controllable generation framework supporting various inputs such as keyboard, controller, trajectory, and voice. Research high-fidelity generation under sparse control signals and explore the extension of conditional control paradigms in the video domain. Achieve the decoupling and combination of trajectory control, camera control, motion control, and posture control. Design dedicated control modules tailored to different game genres. Develop video generation capabilities for multi-player collaborative control, ensuring low-latency response and inter-frame state retention. Collaborate with the Engine/Agent teams to define standardized interfaces for controllable signals. Drive the joint optimization of controllable generation and Reinforcement Learning post-training.

Who We Look For

Ph.D. in AI-related fields, focusing on Computer Vision/Deep Learning. Proficient in conditional generation models and multi-player/multi-channel control technologies; familiar with the principles of diffusion models. Project experience in camera control, trajectory control, or posture control. Understanding of game engine input/output logic and frame synchronization mechanisms. Proficient in Python/PyTorch, with publications in controllable video generation or conditional generation. Experience in Game AI or game development is preferred. Experience in real-time/interactive video generation projects is preferred.

Equal Employment Opportunity at Tencent

As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.

Who we are

Tencent is a world-leading internet and technology company that develops innovative products and services to improve the quality of life for people around the world.

Equal Employment Opportunity at Tencent

As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.