EDB-IPP Project: Personalization and Long-Context Modeling in Large Language Models

Rakuten Kobo Inc.; Singapore; On-site; SGD 42,000 - 66,000; Full time

Job summary

Rakuten Asia, in partnership with the Economic Development Board (IPP), seeks PhD students to advance personalization and long-context modeling in large language models. Candidates should have strong hands-on ML/DL/NLP skills and experience in developing and training PyTorch models.

Joint supervision and shared infrastructure enable large-scale experiments, publications, open-source prototypes, and scalable frameworks for personalized LLM deployment, with full sponsorship for postgraduate

Qualifications

• Robust understanding of deep learning, ML and NLP required.
• Hands-on expertise in developing/training PyTorch models.

Responsibilities

• Joint supervision of PhD students with IPP, shared infra for large-scale experiments.
• Output includes publications, open-source prototypes, and scalable LLM deployment frameworks.

Skills

Deep learning

Machine learning

Natural language processing

PyTorch

Tools

Python

Job description

Job Description: Rakuten Asia, in partnership with the Economic Development Board (EDB) through the Industrial Postgraduate Programme (IPP), is seeking new PhD students. We are looking for individuals with a robust understanding of deep learning, machine learning, and natural language processing to contribute to our innovative research projects. Essential requirements include proven hands-on expertise and strong engineering skillsets, specifically in the development and training of PyTorch models. IPP Programme Benefits Candidates successfully selected for this programme will receive full sponsorship for their postgraduate studies and will be hired by Rakuten Asia upon successful completion.

Collaboration Model

The collaboration will include joint supervision of PhD students, shared infrastructure access for large-scale experiments, and regular research exchange. Outputs will include publications, open-source prototypes, and scalable frameworks for personalized LLM deployment.

Project Outline

Project Title: Personalization and Long-Context Modeling in Large Language Models

Introduction

We are entering a phase in the development of Large Language Models (LLMs), where personalization, long-context understanding, and continual interaction with users are becoming critical differentiators. This research initiative seeks to push the boundaries of user-adaptive, memory-augmented, and privacy-aware LLMs that can reason over long-term history while preserving efficiency and alignment. Our team brings experience in training and evaluating cutting-edge LLMs, and we invite academic collaborators to join us in shaping the next generation of user-centric AI systems.

Objectives

Advance foundational techniques for personalizing LLMs over long, evolving contexts. Develop scalable methods for encoding and decoding extended user interaction history. Benchmark and prototype systems that integrate memory, retrieval, and adaptation in real-world applications. Train and support PhD-level talent through joint supervision and research internships.

Proposed Research Areas

• Long-Context Representation and Compression Explore architectures (e.g. retrieval-augmented, segment-aware transformers, state-space models) that can efficiently handle user histories spanning millions of tokens.
• Personalization without Fine-Tuning Develop modular personalization techniques using adapters and user embeddings. Emphasize continual learning methods that avoid full-model retraining.
• Alignment and Safety for Personalized Models Develop evaluation protocols and mitigation strategies to ensure personalized behavior remains aligned with safety constraints and social norms under extensive user adaptation.
• Efficient Infrastructure for Persistent Context Design systems that support long-term memory and personalization with low-latency access to evolving user state.

Rakuten is an equal opportunities employer and welcomes applications regardless of sex, marital status, ethnic origin, sexual orientation, religious belief or age.

Rakuten Asia is the regional headquarters of Rakuten Group Inc, a global leader in internet services and innovation. Located in the heart of Singapore, Rakuten Asia drives the growth and development of Rakuten’s businesses across the APAC region. Recognized and certified as a "Great Place to Work" since 2022, Rakuten Asia is committed to empowering individuals, communities and businesses through cutting-edge technology, data-driven solutions, and a culture of collaboration. From e-commerce, fintech, sports, and even entertainment, our work is diverse, exciting, and impactful. We believe in empowering our people to grow, innovate, and make a difference. If you’re looking for a workplace where your talent is valued, where your contributions matter, and where you can play a part in shaping the future of technology and society, Rakuten Asia is the place for you.