Audio Algorithm Researcher - Immersive Intelligent

TikTok; Sydney; On-site; AUD 120,000 - 190,000; Full time

Job summary

TikTok's Multimedia Lab Audio Innovation team in Sydney is seeking researchers to push immersive audio technology through ML models, codec optimization, and participation in international audio standards.

You will prototype self-developed algorithms for immersive audio understanding, work on short video, live streaming, VR/AR contexts, and collaborate with cross-functional teams shaping future audio experiences.

Qualifications

• Master's degree or above in electronic information, computer, multimedia, Machine Learning, AI.
• PhD degree majors in related fields preferred.
• Experience with 3D Spatial Audio rendering, GAN/Diffusion audio processing, voiceprint/wake-up, sound event detection, automatic speech recognition, NLP.

Responsibilities

• Research and implement the department's self-developed next-generation immersive intelligent audio understanding and processing algorithm system.
• Implement and optimize immersive intelligent audio codec and processing system for short Video On Demand, LIVE, VR/MR and other scenarios.
• Follow up and participate in domestic and international audio standards, write high-quality technical proposals, and promote standard work.

Skills

3D Spatial Audio

GAN/Diffusion audio

Voiceprint wake-up

Sound event detection

Automatic Speech Recognition

Natural Language Processing

Python

C++

TensorFlow

PyTorch

Kaldi

English communication

Education

Master's degree or above in electronic information / computer / multimedia / ML / AI

PhD preferred

Tools

Kaldi

TensorFlow

PyTorch

Job description

Responsibilities

Team Introduction

Welcome to the Audio Innovation team under TikTok's most pioneering research team - Multimedia Lab! We are dedicated to pushing the boundaries of immersive audio technology and standardization. In addition to supporting TikTok requirements including short video, live-streaming, content creation tools and also VR/AR experiences, we also stay up-to-date with the latest research in the industry and participate in audio Standards Developing Organizations(SDO) such as MPEG, 3GPP, and IETF, etc. As part of our commitment to innovation, we proactively conduct R&D using Machine Learning and NN models(especially generative models) for immersive audio technology. If you're looking to work with a team that values creativity, innovation, and collaboration, we'd love to hear from you. Please join us to reshape the audio world together.

Responsibilities

• Research and implement the department's self-developed next-generation immersive intelligent audio understanding and processing algorithm system.
• Implement and optimize immersive intelligent audio codec and processing system, responsible for application iteration in short Video On Demand, LIVE, VR/MR and other business scenarios.
• Follow up and participate in domestic and international audio standards, write high-quality standard technical proposals, and promote domestic and international immersive intelligent audio standard work.

Qualifications

Minimum Qualifications:

• Master's degree or above majors in electronic information, computer, multimedia, Machine Learning, AI artificial intelligence.
• Research experience in one or several fields such as 3D Spatial Audio rendering, GAN/Diffusion audio processing, voiceprint/wake-up, sound event detection, automatic speech recognition, Natural Language Processing, etc.
• Familiar with data structures and algorithms, deep network model design and tuning, proficient in open source tools such as Kaldi, TensorFlow, Pytorch, etc., proficient in Python/C++ programming languages, experience in model training and exploration of large-scale training datasets is preferred.

Preferred Qualifications:

• PhD degree majors in related majors such as electronic information, computer, multimedia, Machine Learning, AI artificial intelligence.
• Hands-on experience in Digital Signal Processing and Artificial Intelligence/Deep learning system development.
• Priority will be given to those who have published papers in relevant international conferences or mainstream journals (ICASSP, Interspeech, ASRU, ICML, NeurIPS, AAAAI, etc.)

About TikTok

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Acknowledgment of Country

In the spirit of reconciliation, TikTok acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.