Audio Algorithm Researcher - Immersive Intelligent

TikTok; Sydney; On-site; AUD 120,000 - 180,000; Full time

Job summary

TikTok's Audio Innovation team in Sydney is seeking a research-focused engineer to push immersive audio technology across short video, live streaming, VR/AR, and content tools. You will develop self-developed algorithms for immersive audio understanding and processing.

You will contribute to international standards bodies, publish proposals, and work with ML/DL models, Kaldi/TensorFlow/PyTorch, and Python/C++. A strong background in 3D spatial audio is preferred.

Qualifications

• Master's degree or higher in electronic information, computer science, multimedia, ML/AI.
• Experience in 3D Spatial Audio rendering or GAN/Diffusion audio processing, voiceprint/wake-up, sound event detection, ASR or NLP.
• Proficiency in Python and C++, familiarity with Kaldi/TensorFlow/PyTorch and large-scale model training.

Responsibilities

• Research and implement the department's self-developed immersive intelligent audio understanding and processing algorithm system.
• Develop and optimize immersive audio codec and processing for short video, LIVE, VR/MR and related scenarios.
• Follow up on domestic and international audio standards; write high-quality technical proposals and contribute to standards work.

Skills

Data structures & algorithms

Deep learning model design

Python programming

C++ programming

Model training on large datasets

Education

Master's degree or above in electronic information, computer, multimedia, ML/AI

Tools

Kaldi

TensorFlow

PyTorch

Job description

Responsibilities

Team Introduction

Welcome to the Audio Innovation team under TikTok's most pioneering research team - Multimedia Lab! We are dedicated to pushing the boundaries of immersive audio technology and standardization. In addition to supporting TikTok requirements including short video, live-streaming, content creation tools and also VR/AR experiences, we also stay up-to-date with the latest research in the industry and participate in audio Standards Developing Organizations(SDO) such as MPEG, 3GPP, and IETF, etc. As part of our commitment to innovation, we proactively conduct R&D using Machine Learning and NN models(especially generative models) for immersive audio technology. If you're looking to work with a team that values creativity, innovation, and collaboration, we'd love to hear from you. Please join us to reshape the audio world together.

Responsibilities

• Research and implement the department's self-developed next-generation immersive intelligent audio understanding and processing algorithm system.
• Implement and optimize immersive intelligent audio codec and processing system, responsible for application iteration in short Video On Demand, LIVE, VR/MR and other business scenarios.
• Follow up and participate in domestic and international audio standards, write high-quality standard technical proposals, and promote domestic and international immersive intelligent audio standard work.

Qualifications

Minimum Qualifications:

• Master's degree or above majors in electronic information, computer, multimedia, Machine Learning, AI artificial intelligence.
• Research experience in one or several fields such as 3D Spatial Audio rendering, GAN/Diffusion audio processing, voiceprint/wake-up, sound event detection, automatic speech recognition, Natural Language Processing, etc.
• Familiar with data structures and algorithms, deep network model design and tuning, proficient in open source tools such as Kaldi, TensorFlow, Pytorch, etc., proficient in Python/C++ programming languages, experience in model training and exploration of large-scale training datasets is preferred.

Preferred Qualifications:

• PhD degree majors in related majors such as electronic information, computer, multimedia, Machine Learning, AI artificial intelligence.
• Hands-on experience in Digital Signal Processing and Artificial Intelligence/Deep learning system development.
• Priority will be given to those who have published papers in relevant international conferences or mainstream journals (ICASSP, Interspeech, ASRU, ICML, NeurIPS, AAAAI, etc.)

About TikTok

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an \"Always Day 1\" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Acknowledgment of Country

In the spirit of reconciliation, TikTok acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.