Senior Researcher, Speech Synthesis and Multimodal LLM

L&Q OASIS PTE. LTD.; Singapore; Hybrid; SGD 120,000 - 180,000; Full time

Job summary

Tencent's Lightspeed Tech Center is seeking a PhD-level researcher to advance speech synthesis and multimodal LLMs for real-time spoken interaction. You will prototype and productionize TTS, voice conversion, and audio generation within online applications, collaborating with cross-functional teams to scale experiments to deployment.

Strong background in speech processing, diffusion/autoregressive models, and Python-based DL frameworks is essential; publications at top venues are a plus.

Qualifications

• Ph.D. in Computer Science, Electrical Engineering, Signal Processing, or closely related field.
• Strong foundation in speech/audio processing and modern generative models.
• Hands-on experience extending LLMs to speech/audio modalities.
• Experience with real-time interaction modeling is a plus.

Responsibilities

• Research and develop advanced speech synthesis and generation algorithms (e.g., TTS, voice conversion, sound/music generation) based on LLMs.
• Develop and optimize speech and audio synthesis systems for online applications.
• Explore and advance full-duplex/streaming multimodal LLM capabilities in speech understanding and generation.
• Collaborate cross-functionally with research and engineering teams from prototyping to production.

Skills

Python

Deep Learning

Speech Processing

TTS

Multimodal LLM

Education

Ph.D. in CS/EE/Signal Processing

Tools

PyTorch

TensorFlow

Job description

Business Unit LIGHTSPEED STUDIOS is made up of passionate players who advance the art & science of game development through great stories, great gameplay, and advanced technology. We are focused on bringing next generation experiences to gamers who want to enjoy them anywhere, anytime, across multiple genres and devices.

About the Hiring Team

Lightspeed Tech Center is a R&D department under Lightspeed Studios which develop PUBG Mobile and other high-quality games. Our Tech Center leads the research, exploration, and discovery of innovative technologies and provides technical services for all games during all phases of life cycle, including engine, audio, QA, AI, next generation game, technical cooperation, etc.

What the Role Entails

Research and develop advanced speech synthesis and generation algorithms (e.g., TTS, voice conversion, sound/music generation) based on LLMs, multimodal/omnimodal LLMs. Develop and optimize speech and audio synthesis systems for online applications, improving effectiveness, efficiency, and scalability. Explore and advance full-duplex/streaming multimodal LLM capabilities in speech understanding, generation, and real-time spoken interaction. Collaborate cross-functionally with research and engineering teams from prototyping to production.

Who We Look For

Ph.D. in Computer Science, Electrical Engineering, Signal Processing, or a closely related field. Strong foundation in speech/audio processing and modern generative models (e.g., diffusion, flow matching, autoregressive, codec-based approaches). Hands-on experience extending LLMs to speech/audio modalities (e.g., speech tokenizers, multimodal adapters, speech-text joint training). Experience with full-duplex or streaming spoken dialogue systems and real-time interaction modeling is a plus. Proficient in Python and deep learning frameworks (e.g., PyTorch); experience with distributed training is a plus. Track record of publications at top-tier venues (e.g., ICML, NeurIPS, ICLR, ACL, ICASSP, Interspeech).

Equal Employment Opportunity at Tencent

As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.

Who we are Tencent is a world-leading internet and technology company that develops innovative products and services to improve the quality of life for people around the world.

Equal Employment Opportunity at Tencent

As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.