LLM/MLLM Algorithm Engineer - Global E-Commerce Technology - Algorithm Singapore Regular

ByteDance; Singapore; On-site; SGD 150,000 - 230,000; Full time

Job summary

ByteDance in Singapore is seeking an LLM/MLLM Algorithm Engineer for the Global E-Commerce team to develop domain-specific large models for NLP, CV, and multimodal tasks and apply them to business scenarios.

You will work on governance, content review, and optimization, exploring prompts, fine-tuning, and PEFT to deliver scalable, multilingual models that improve search, recommendations, and moderation across ByteDance's e-commerce ecosystem.

Qualifications

• Strong background in ML with publications or competitions preferred.
• Experience with MapReduce/Spark is preferred.
• Experience training and deploying TensorFlow/PyTorch models.

Responsibilities

• Build domain-specific LLM/MLLMs for e-commerce and integrate domain knowledge.
• Improve merchant/product/video/live-stream governance through algorithm optimization.
• Perform data construction, foundational model enhancement, instruction fine-tuning, CoT and PEFT.
• Address long text/sequence, few-shot learning, content moderation and policy recommendation challenges.
• Research and optimize NLP and multimodal models for multilingual, multi-task scenarios.

Skills

Machine Learning fundamentals

Big Data frameworks

Model Training & Deployment

Quantization & PEFT

Tools

TensorFlow

PyTorch

TensorRT

Job description

LLM/MLLM Algorithm Engineer - Global E-Commerce

Location:

Team:

Algorithm

Employment Type:

Regular

Job Code:

A115740A

Share this listing:

Responsibilities

About the TeamThe team focuses on the development of large models in NLP, CV, and multimodal domains. The team aims to establish state-of-the-art (SOTA) models while delving deeply into these areas to optimize algorithms for e-commerce data, thereby enhancing business outcomes. By refining algorithms and collaborating with business operations, the team strives to govern the quality and ecosystem of ByteDance's e-commerce products comprehensively. This includes addressing issues such as risks, violations, and low-quality content, while also fostering the e-commerce ecosystem. The ultimate goal is to maximize platform governance efficiency and effectiveness.

• Large language Model Algorithm Development: Build domain-specific large language models (LLM/MLLM) for e-commerce, integrating domain knowledge to rapidly apply models to business scenarios.
• E-commerce Governance Optimization: Understand e-commerce governance scenarios deeply to improve merchant/product/video/live-stream/IPR governance through algorithm optimization. Develop state-of-the-art intelligent review systems capable of “knowing why to reject” decisions.
• Model Enhancement: Handle tasks like data construction, foundational model enhancement, instruction fine-tuning, chain-of-thought (CoT), and parameter-efficient fine-tuning (PEFT) to achieve optimal model performance in the e-commerce domain.
• Problem Solving for Governance Applications: Address challenges such as long text/sequence modeling, few-shot learning, content moderation, violation detection, and policy recommendation using large models and multimodal approaches.
• Model Development and Optimization: Research and optimize e-commerce-specific NLP and multimodal large models to improve multilingual, multi-task, and multi-modal algorithm performance across various e-commerce scenarios.

Qualifications

Minimum Qualifications

• Strong Technical Background: Solid foundation in machine learning and familiarity with cutting-edge AI technologies. Preference for candidates with high-quality academic publications or competition experience.
• Big Data Proficiency: Familiarity with big data frameworks and applications like MapReduce/Spark is preferred.
• Model Training Expertise: Experience with training and deploying TensorFlow/PyTorch models.
• Model Compression and Inference Optimization: Understanding of research and techniques for model compression and inference acceleration, including quantization, pruning, distillation, and TensorRT optimization.

Preferred Qualifications

• Computer Vision (CV) & Multimodal: In-depth knowledge in fields such as image search, classification, segmentation, detection, OCR, graph neural networks, multimodal learning, unsupervised/self-supervised learning, etc. Experience in CV/multimodal large model projects is preferred, especially for e-commerce scenarios like video/product multimodal modeling. Strong practical abilities, with achievements in competitions such as Kaggle, COCO, ImageNet, ActivityNet, ICPC, etc. Publications in top-tier conferences (e.g., CVPR, ICCV, ECCV) are a plus.
• Natural Language Processing (NLP): Expertise in areas such as pretraining, NLU, multilingual and cross-lingual learning, NLG, transfer learning, and semi-supervised learning. Experience in LLM-related projects and applying them to unify e-commerce NLP tasks is a plus. Strong practical abilities, with achievements in competitions like Kaggle, GLUE, Super GLUE, CLUE, etc. Publications in top-tier conferences (e.g., ACL, EMNLP) are a plus.
• Knowledge of training acceleration methods such as mixed precision training and distributed training is a plus.

Job Information

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.