Research Associate (Audio LLM)

NANYANG TECHNOLOGICAL UNIVERSITY; Singapore; On-site; SGD 60,000 - 90,000; Full time

Job summary

A leading educational institution in Singapore is seeking a Research Associate for the Audio LLM development initiatives within the SEA-LION project under AI Singapore. The successful candidate will engage in developing and training large audio language models, along with building datasets and evaluation tools. Candidates should possess a Masters or PhD in relevant fields and have familiarity with PyTorch and LLM training processes. This position emphasizes collaboration and innovation in AI research.

Qualifications

• Masters or PhD in computer science, machine learning, or equivalent.
• Familiar with PyTorch and Large Language Model’s Training.
• Excellent communication and interpersonal skills required.

Responsibilities

• Contribute to algorithm design for audio LLM products.
• Develop and optimize data processing pipelines for multilingual datasets.
• Conduct literature reviews on multimodal LLM techniques.

Skills

Familiar with PyTorch

Large Language Model’s Training

Data driven

Excellent communication and interpersonal skills

Proactively identify opportunities

Education

Masters or PhD in computer science, machine learning, AI

Tools

Data pipelines

Job description

AI Singapore (AISG) is a national AI programme launched by the National Research Foundation (NRF) to anchor deep national capabilities in Artificial Intelligence (AI).

The programme office is hosted by the Nanyang Technological University and brings together all Singapore-based research institutions and the vibrant ecosystem of Institutes of Higher Learning (IHLs) in developing AI products to perform use-inspired research, grow the knowledge, create the tools, and develop the talent to power Singapore's AI efforts.

We are looking for a Research Associate for the Audio LLM development efforts of the SEA-LION project under AI Singapore. The successful candidate will help develop and train foundation/large audio language models, build datasets/pipelines for data development, evaluation benchmarks and developer enablement tools for the SEA-LION audio initiatives.

Key Responsibilities

• Contribute to algorithm design, training and serving SEA-LION team’s LLM audio products.
• Participate in ongoing integration and optimization with entities both in AI Singapore and external collaborators to develop AI Singapore’s LLM solutions.
• Conduct literature review, identify relevant state-of-the-art techniques for multimodal LLMs (audio and text).
• Develop data processing pipeline for multilingual audio datasets.
• Keep abreast of latest developments in NLP, AI and LLMs.

Job Requirements

• Masters or PhD in computer science, machine learning, AI, and other equivalent relevant fields.
• Familiar with PyTorch, Large Language Model’s Training and Data pipelines.
• Data driven, creative, and resourceful.
• Excellent communication and interpersonal skills.
• Able to proactively identify opportunities, take initiative and multi-task in a fast paced environment.
• Background in IT disciplines, working with a wide variety of tools and solutions.
• Up-to-date with AI research areas and current trends, especially their application to solving problems.

Bonus

• Contribution to past open-source projects.
• Experience as a computer engineer working within a small/medium organization.
• Additional interest in Natural Language Processing (NLP).

We regret that only shortlisted candidates will be notified.