Multimodal LLM Algorithm Engineer Intern (Global E-Commerce, Knowledge Graph) - 2027 Start (PhD)

TikTok; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

TikTok, a global leader in short-form video, seeks a PhD-level researcher/engineer in Singapore to advance multimodal AI for content-commerce. You will work on product catalog, pricing intelligence, and intelligent agents to power cross-lingual product matching and intelligent recommendations.

The role involves developing scalable multimodal models, integrating data from video and product feeds, and delivering production-grade algorithms that influence global content commerce strategies.

Qualifications

• Pursuing or holding a PhD in a technical discipline with strong research or practical experience in NLP/CV.
• Experience with multimodal learning, large models, and agents is highly valued.
• Proficiency in PyTorch or TensorFlow and model development is required.

Responsibilities

• Build global product catalog and content understanding systems with semantic representations.
• Develop algorithms for identical product matching, deduplication, and cross-lingual aggregation.
• Build pricing algorithms for price comparison, pricing, monitoring, and anomaly detection.
• Construct multimodal semantic links across video-product relationships for trend understanding.
• Explore next-generation generative search and AIGC-driven recommendations.
• Design generative algorithms for engaging e-commerce visuals, including virtual try-on.
• Explore Agents such as price comparison, product analysis, and content AIGC Agents using RAG and tool calling.
• Own end-to-end algorithm workflow from data construction to deployment and iteration.

Skills

NLP

CV

Multimodal learning

Large models

Agents

PyTorch

TensorFlow

Education

PhD in Software Development, CS, or related

Tools

TensorRT

LLM serving

Distributed training

Job description

About the Team

We are part of the Global E-commerce Algorithm team, building multimodal content understanding, product understanding, semantic matching, pricing intelligence, and intelligent Agent capabilities for global content-commerce scenarios. Leveraging our massive-scale video content and global product data, we explore NLP, CV, Multimodal LLMs, Video LLMs, Multimodal Embedding & SID, Multimodal Reasoning, and Agent technologies to power product catalog construction, identical product matching, content-product linking, price comparison, AIGC content generation, and next-generation generative search and recommendation.

Responsibilities

• Build global product catalog and content understanding systems, modeling products, videos, images, merchants, and brands with structured and semantic representations.
• Develop algorithms for identical product matching, product/merchant/brand deduplication, and cross-lingual product aggregation, addressing multimodal matching, real-time aggregation, multi-granularity clustering, and semantic alignment.
• Build pricing algorithms for price comparison, product pricing, price monitoring, and anomaly detection, supporting subsidy programs, price competitiveness analysis, and supply optimization.
• Construct multimodal semantic links across video-product, product-product, and video-video relationships to support trend understanding, product mining, AIGC generation, and content-commerce supply optimization.
• Explore next-generation generative search and recommendation through full-format representation learning and SID modeling across videos, livestreams, products, and queries.
• Design and develop generative algorithms tailored for high engaging, high conversion e-commerce visual creatives, solving challenges in identity-preserving and aesthetic style consistency to produce production-grade intelligent background synthesis，virtual try-on, and localised lifestyle scene generation.
• Explore business-facing Agents such as price comparison Agents, product analysis Agents, content AIGC Agents, and merchant operation Agents, leveraging RAG, tool calling, planning, reasoning, and automated evaluation.
• Own the end-to-end algorithm workflow, including data construction, model training, evaluation, deployment, badcase analysis, and continuous iteration.

Minimum Qualifications

• Currently Pursuing a PhD in Software Development, Computer Science, Computer Engineering, or a related technical discipline.
• Strong research or practical experience in NLP, CV, generative models (e.g. Diffusion，GANs，ControlNet) , multimodal learning, large models, or Agents;
• Proficiency in PyTorch / TensorFlow and hands-on experience in model training, tuning, and deployment;

Preferred Qualifications

• Experience with LLM/VLM, Embedding/SID, RAG, Tool Calling, or Agent Planning is preferred.
• experience with distributed training, mixed precision, inference acceleration, TensorRT, or LLM serving optimization is a plus.
• Experience in multimodal retrieval, product understanding, content understanding, search/recommendation, pricing algorithms, intelligent Agents, or AIGC projects is preferred.
• Passion for frontier AI technologies; familiarity with Video LLMs, Multimodal Reasoning, vision-language alignment, long-video understanding, or generative search/recommendation is a plus.
• Publications, open-source contributions, or strong algorithm competition records are preferred. Strong communication, ownership, and a drive to create real business impact are highly valued.

Job Information

About TikTok

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.