Controllable Video Generation Researcher

L&Q OASIS LIMITED; Greater London; Vor Ort; GBP 68.000 - 91.000; Vollzeit

Zusammenfassung

Tencent Lightspeed Studios at the Lightspeed Tech Center is seeking a researcher to design and implement a multimodal controllable video generation framework for next-gen gaming, with inputs from keyboard, controller, trajectory and voice.

The role emphasizes high-fidelity generation under sparse control signals, integration with game engines, and collaboration across Engine/Agent teams, including reinforcement learning post-training.

Qualifikationen

• Ph.D. in AI with a focus on Computer Vision/Deep Learning.
• Expertise in conditional generation and diffusion models.
• Project experience in camera, trajectory, or posture control.
• Understanding of game engine input/output logic and frame sync.
• Proficient in Python/PyTorch; publications in controllable video generation.

Aufgaben

• Design a multimodal controllable generation framework supporting keyboard, controller, trajectory, and voice.
• Research high-fidelity generation under sparse control signals and extend conditional control paradigms.
• Decouple and combine trajectory, camera, motion, and posture control across modules.
• Develop dedicated control modules for different game genres.
• Build video generation for multiplayer collaboration with low latency and inter-frame retention.
• Collaborate with Engine/Agent teams to standardize controllable signal interfaces.
• Drive joint optimization of controllable generation and reinforcement learning post-training.

Kenntnisse

Conditional generation

Multi-player control

Python/PyTorch

Publications in controllable video

Game AI / game development

Real-time video generation

Diffusion models

Frame synchronization concepts

Ausbildung

Ph.D. in AI with Computer Vision/Deep Learning focus

Tools

Python

PyTorch

Game engines (input/output)

Jobbeschreibung

Business Unit LIGHTSPEED STUDIOS is made up of passionate players who advance the art & science of game development through great stories, great gameplay, and advanced technology. We are focused on bringing next generation experiences to gamers who want to enjoy them anywhere, anytime, across multiple genres and devices.

About the Hiring Team

Lightspeed Tech Center is a R&D department under Lightspeed Studios which develop PUBG Mobile and other high-quality games. Our Tech Center leads the research, exploration, and discovery of innovative technologies and provides technical services for all games during all phases of life cycle, including engine, audio, QA, AI, next generation game, technical cooperation, etc.

What the Role Entails

1. Design a multimodal controllable generation framework supporting various inputs such as keyboard, controller, trajectory, and voice.
2. Research high-fidelity generation under sparse control signals and explore the extension of conditional control paradigms in the video domain.
3. Achieve the decoupling and combination of trajectory control, camera control, motion control, and posture control.
4. Design dedicated control modules tailored to different game genres.
5. Develop video generation capabilities for multi-player collaborative control, ensuring low-latency response and inter-frame state retention.
6. Collaborate with the Engine/Agent teams to define standardized interfaces for controllable signals.
7. Drive the joint optimization of controllable generation and Reinforcement Learning post-training.

Who We Look For

1. Ph.D. in AI-related fields, focusing on Computer Vision/Deep Learning.
2. Proficient in conditional generation models and multi-player/multi-channel control technologies; familiar with the principles of diffusion models.
3. Project experience in camera control, trajectory control, or posture control.
4. Understanding of game engine input/output logic and frame synchronization mechanisms.
5. Proficient in Python/PyTorch, with publications in controllable video generation or conditional generation.
6. Experience in Game AI or game development is preferred.
7. Experience in real-time/interactive video generation projects is preferred.

Equal Employment Opportunity at Tencent As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.

Who we are

Tencent is a world-leading internet and technology company that develops innovative products and services to improve the quality of life for people around the world.

Equal Employment Opportunity at Tencent As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.