Multimodal LLM Algorithm Engineer Intern (Global E-Commerce, Knowledge Graph) - 2027 Start (PhD)

ByteDance; Singapore; On-site; SGD 28,000 - 50,000; Part time

Job summary

ByteDance is seeking a Multimodal LLM Algorithm Engineer Intern for a 2027 start in Singapore. You will contribute to global e-commerce content understanding, knowledge graphs, and multimodal model development within a dynamic internship program.

You will join the Global E-commerce Algorithm team to build catalog systems, cross-lingual product aggregation, pricing intelligence, and AIGC-enabled search and recommendation. Strong research and PyTorch/TensorFlow experience are valued.

Qualifications

• Pursuing a PhD in Software Development, Computer Science, Computer Engineering, or a related technical discipline.
• Strong research or practical experience in NLP, CV, generative models (e.g. Diffusion，GANs，ControlNet) , multimodal learning, large models, or Agents.
• Proficiency in PyTorch / TensorFlow and hands-on experience in model training, tuning, and deployment.

Responsibilities

• Build global product catalog and content understanding systems, modeling products, videos, images, merchants, and brands with structured and semantic representations.
• Develop algorithms for identical product matching, product/merchant/brand deduplication, and cross-lingual product aggregation, addressing multimodal matching, real-time aggregation, multi-granularity clustering, and semantic alignment.
• Build pricing algorithms for price comparison, product pricing, price monitoring, and anomaly detection, supporting subsidy programs, price competitiveness analysis, and supply optimization.
• Construct multimodal semantic links across video-product, product-product, and video-video relationships to support trend understanding, product mining, AIGC generation, and content-commerce supply optimization.
• Explore next-generation generative search and recommendation through full-format representation learning and SID modeling across videos, livestreams, products, and queries.
• Design and develop generative algorithms tailored for high engaging, high conversion e-commerce visual creatives, solving challenges in identity-preserving and aesthetic style consistency to produce production-grade intelligent background synthesis，virtual try-on, and localised lifestyle scene generation.
• Explore business-facing Agents such as price comparison Agents, product analysis Agents, content AIGC Agents, and merchant operation Agents, leveraging RAG, tool calling, planning, reasoning, and automated evaluation.
• Own the end-to-end algorithm workflow, including data construction, model training, evaluation, deployment, badcase analysis, and continuous iteration.

Skills

NLP

CV

Multimodal learning

Large models

Agents

Education

PhD in CS/SE or related

Tools

PyTorch

TensorFlow

Job description

Multimodal LLM Algorithm Engineer Intern (Global E-Commerce, Knowledge Graph) - 2027 Start (PhD)

Location:

Team:

Technology

Employment Type:

Intern

Job Code:

A248264A

Share this listing:

About the Team

We are part of the Global E-commerce Algorithm team, building multimodal content understanding, product understanding, semantic matching, pricing intelligence, and intelligent Agent capabilities for global content-commerce scenarios. Leveraging our massive-scale video content and global product data, we explore NLP, CV, Multimodal LLMs, Video LLMs, Multimodal Embedding & SID, Multimodal Reasoning, and Agent technologies to power product catalog construction, identical product matching, content-product linking, price comparison, AIGC content generation, and next-generation generative search and recommendation. We are looking for talented individuals to join us for an internship. PhD internships at Our Company provide students with the opportunity to actively contribute to our products and research, as well as to the organization's future plans and emerging technologies. Our dynamic internship experience blends hands-on learning, enriching community-building and professional development events, and collaboration with industry experts.

Responsibilities

• Build global product catalog and content understanding systems, modeling products, videos, images, merchants, and brands with structured and semantic representations.
• Develop algorithms for identical product matching, product/merchant/brand deduplication, and cross-lingual product aggregation, addressing multimodal matching, real-time aggregation, multi-granularity clustering, and semantic alignment.
• Build pricing algorithms for price comparison, product pricing, price monitoring, and anomaly detection, supporting subsidy programs, price competitiveness analysis, and supply optimization.
• Construct multimodal semantic links across video-product, product-product, and video-video relationships to support trend understanding, product mining, AIGC generation, and content-commerce supply optimization.
• Explore next-generation generative search and recommendation through full-format representation learning and SID modeling across videos, livestreams, products, and queries.
• Design and develop generative algorithms tailored for high engaging, high conversion e-commerce visual creatives, solving challenges in identity-preserving and aesthetic style consistency to produce production-grade intelligent background synthesis，virtual try-on, and localised lifestyle scene generation.
• Explore business-facing Agents such as price comparison Agents, product analysis Agents, content AIGC Agents, and merchant operation Agents, leveraging RAG, tool calling, planning, reasoning, and automated evaluation.
• Own the end-to-end algorithm workflow, including data construction, model training, evaluation, deployment, badcase analysis, and continuous iteration.

Qualifications

Minimum Qualifications

• Currently Pursuing a PhD in Software Development, Computer Science, Computer Engineering, or a related technical discipline.
• Strong research or practical experience in NLP, CV, generative models (e.g. Diffusion，GANs，ControlNet) , multimodal learning, large models, or Agents;
• Proficiency in PyTorch / TensorFlow and hands-on experience in model training, tuning, and deployment;

Preferred Qualifications

• Experience with LLM/VLM, Embedding/SID, RAG, Tool Calling, or Agent Planning is preferred.
• experience with distributed training, mixed precision, inference acceleration, TensorRT, or LLM serving optimization is a plus.
• Experience in multimodal retrieval, product understanding, content understanding, search/recommendation, pricing algorithms, intelligent Agents, or AIGC projects is preferred.
• Passion for frontier AI technologies; familiarity with Video LLMs, Multimodal Reasoning, vision-language alignment, long-video understanding, or generative search/recommendation is a plus.
• Publications, open-source contributions, or strong algorithm competition records are preferred.
• Strong communication, ownership, and a drive to create real business impact are highly valued.

Job Information

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.