AI Agent Engineer: Multimodal Dialogue, Memory & Safety

SHOPEE IP SINGAPORE PRIVATE LIMITED; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

SHOPEE IP SINGAPORE PRIVATE LIMITED is seeking a researcher to design and develop core agent algorithms, including multi-turn dialogue planning and tool orchestration, with memory graphs for personalized interactions.

You will advance emotion-aware dialogue modeling, LLM alignment and safety strategies (SFT and DPO), and multimodal reasoning integrating vision with dialogue planning for tutoring or adaptive guidance.

Qualifications

• Hands-on research and engineering experience building conversational agents with memory systems.
• Experience with persona-aware and emotion-aware dialogue modeling and LLM alignment (SFT, DPO).
• Experience orchestrating agent pipelines with retrieval, ranking, and tool use.
• First-author publications at top-tier venues on persona-driven dialogue generation.
• Experience building vision-language tutoring/dialogue agents with multimodal reasoning and reinforcement learning for sequential decisions and 3D reconstruction from point clouds.
• Strong Python and Bash; PyTorch and Hugging Face; LoRA/PEFT; prompt engineering; model evaluation pipelines.
• Experience deploying LLMs/VLMs on AWS/GPU clusters; familiar with PostgreSQL, Neo4j, AWS S3.
• Strong problem analysis and ability to work independently and with teams.

Responsibilities

• Design and develop core agent algorithms including multi-turn dialogue planning and tool orchestration.
• Build and maintain agent memory architectures using knowledge graphs.
• Develop emotion-aware dialogue modeling techniques.
• Design and implement LLM alignment and safety strategies (SFT, DPO).
• Build multimodal agent capabilities that integrate vision-language reasoning with dialogue planning.
• Benchmark and deploy LLMs/VLMs across GPU clusters and cloud environments; build evaluation pipelines.
• Track frontier research and represent findings at AI/NLP venues.

Skills

Python

Bash

PyTorch

Hugging Face

LoRA/PEFT

Prompt engineering

Model evaluation

PostgreSQL

Neo4j

AWS S3

research skills

independence

Education

Master's degree or above in CS/AI/NLP

Tools

PostgreSQL

Neo4j

AWS

GPU clusters

Job description

SHOPEE IP SINGAPORE PRIVATE LIMITED is seeking a researcher to design and develop core agent algorithms, including multi-turn dialogue planning and tool orchestration, with memory graphs for personalized interactions.

You will advance emotion-aware dialogue modeling, LLM alignment and safety strategies (SFT and DPO), and multimodal reasoning integrating vision with dialogue planning for tutoring or adaptive guidance.