AI Infra Optimization Engineer Graduate (TikTok Global E-Commerce Recommendation & Search Archi[...]

TikTok; Singapore; On-site; SGD 60,000 - 120,000; Full time

Job summary

TikTok in Singapore seeks graduates for a role in E-commerce Recommendation Infra, working on scalable systems for LLM-based recommendations. You will integrate LLM tech, deploy training/inference optimizations, and collaborate with ML engineers to push end-to-end generative recommendation tech.

The team focuses on lifelong behavior modeling, model scale-up, and deploying foundation models with open-source tools. Apply early and include graduation date in your resume.

Qualifications

• Bachelor's or Master's in AI, CS, Software or related field.
• Strong coding skills in C++, CUDA, Triton and Python.
• Familiarity with GPU architecture and distributed training is desirable.
• Proficiency in C, C++, Java or Golang and good communication.
• Ownership mindset and ability to work with teams.

Responsibilities

• Deeply integrate LLM and recommendation technologies and optimize training/inference.
• Develop automated model optimization for PyTorch-based frameworks.
• Design and implement next-gen model infra with open-source components.
• Research, innovate, and productionize end-to-end generative recommendations.
• Optimize throughput for high-performance GPU kernels and multi-GPU setups.

Skills

C++/CUDA/Triton/Python

GPU architecture

Distributed training

C/Java/Golang

Communication and ownership

Education

Bachelor's or Master's in AI/CS/Software

Tools

Megatron-LM

DeepSpeed

vLLM

SGLang

TensorRT-LLM

Job description

Responsibilities

Team Introduction: E-commerce is a new and fast growing business that aims at connecting all customers to excellent sellers and quality products, through E-commerce live-streaming, E-commerce short videos, and commodity recommendation. Our E-commerce Recommendation Infra team is responsible for building up and optimizing the infrastructure for such recommendation systems, so as to provide the best experience for our users. We work closely with applied machine learning engineers and build scalable systems to support all kinds of innovative algorithms and techniques.

Project introduction

With The Rapid Development Of LLM Technologies, Traditional Deep Learning Algorithms And System Architectures For Recommendation Are Facing Both Transformational Challenges And Opportunities:

• (1) Lifelong Behavior Modeling and Model Scale-up
• (2) End-to-End Generative Recommendation

We are looking for talented individuals to join our team. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth.

Successful candidates must be able to commit to an onboarding date by the end of the year. Please state your availability and graduation date clearly in your resume.

Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to our Company and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early.

Responsibilities

• Deeply integrate LLM and recommendation technologies; develop, deploy, and optimize LLM training and inference techniques for recommendation foundation models; and solve large-model engineering challenges in recommendation scenarios.
• Provide highly automated, agentic, and performance-oriented model optimization solutions for frameworks such as PyTorch.
• Build, design, and implement next-generation model infra architectures based on open-source components like Vllm/SGlang/Megatron/VeRL, enabling recommendation foundation models to be deployed in production.
• Co-design with algorithm teams to research, innovate, and productionize end-to-end generative recommendation technologies.
• LLM-native recommendation models and training/inference architectures
• Re-architect recommendation models and the complete training/inference technology stack through secondary development based on PyTorch and LLM components.
• Ultra-long-context modeling of users' lifelong behavioral histories.
• KV cache sharing across multiple user browsing sessions.
• Multimodal recommendation foundation models and downstream fine-tuning tasks.
• Automated, agentic, and extreme-performance model optimization
• Throughput optimization for high-performance GPU kernels and multi-GPU parallelism.
• Extreme performance optimization tailored to the specialized structures of recommendation models.
• Agentic paradigms for performance optimization
• Exploration of new AI infrastructure paradigms enabled by AI-powered productivity.
• Next-generation recommendation system architectures built on foundation models
• Shared modeling and shared computation across retrieval, pre-ranking, ranking, and re-ranking stages.
• Prefill/decode disaggregation and computation graph partitioning tailored to recommendation workloads.
• LLM architectures that support the sparse characteristics of recommendation scenarios.
• Innovation in end-to-end generative recommendation
• Alignment between multimodal LLM foundations and recommendation tasks.
• Implementation, deployment, and optimization of reinforcement learning techniques in recommendation scenarios.
• Data and sample construction for generative recommendation.
• Exploration of new recommendation paradigms and technical approaches.

Qualifications

Minimum Qualifications:

• Individuals who are completing or have recently completed a Bachelor's or Master's degree in Artificial Intelligence, Software Development, Computer Science, Computer Engineering or a related discipline.
• Solid programming skills in C++/CUDA/Triton/Python.
• Familiarity with GPU architecture and distributed training is highly desirable.
• Experience programming in at least one of the following programming languages: C, C++, Java or Golang.
• Effective communication skills and a sense of ownership and drive.

Preferred Qualifications

• Strong programming and algorithmic foundations, with proficiency in languages such as C/C++, Python. Experience with CUDA development and familiarity with TensorRT, Triton, or CUTLASS is preferred.
• Familiarity with research and technical developments in LLM inference acceleration, including but not limited to model quantization, graph compilation, operator optimization, KV cache optimization, and prefill/decode disaggregation.
• Hands‑on knowledge of LLM training and inference technologies, with practical development and production experience using systems such as Megatron-LM, DeepSpeed, vLLM, SGLang, or TensorRT-LLM.
• Extensive experience and broad technical perspective in foundation model engineering, close awareness of open-source developments, and strong independent troubleshooting capabilities.
• Experience in recommendation, advertising, or search model development and optimization, or contributions to open-source foundation model communities, is a plus.

Job Information

About TikTok

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.