Backend Engineer, ARK Large Model Platform (Singapore)

BYTEDANCE PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

ByteDance Pte. Ltd.

in Singapore is seeking an experienced engineer to design and develop core pipeline components for the Ark MaaS platform, supporting API capabilities for text conversations and multimodal generation. You will participate in evolving cloud-native architectures, including Service Mesh, load balancing, and routing, while ensuring high availability and low-latency performance for large-model multimodal tasks.

Qualifications

• Minimum qualifications: B. Sc or higher in Computer Science or related field with at least 3 years of relevant experience.
• Familiar with distributed systems on Linux.
• Proficient in multiple languages (Golang, Python, C/C++, Java, Scala, JavaScript). ACM ICPC/Codeforces winners preferred.

Responsibilities

• Design and develop core pipeline components for Ark MaaS platform (Model as a Service) including API capabilities like text conversations and multimodal generation.
• Contribute to evolutions of cloud-native architectures (Service Mesh, LB, routing) and implement highly available solutions.
• Optimize system performance for large-model multimodal inference with high throughput and low latency.
• Ensure stability under large-scale model invocations and address architectural bottlenecks during traffic surges.

Skills

Golang

Python

C/C++

Java

Scala

JavaScript

Distributed systems

ICPC/Codeforces

Kubernetes

Docker

Istio

Envoy

Education

B. Sc or higher in Computer Science or related field

Tools

Linux

Job description

Responsibilities

About the Team The Applied Machine Learning (AML) - Ark team provides machine learning platform products on VolcanoEngine with cloud native resource scheduling system which intelligently orchestrates different tasks and jobs with minimised costs of every experiment and maximised resource utilisation, rich modelling tools including customised machine learning tasks and web IDE, and multi-framework high performance model inference services. In 2021, through VolcanoEngine, we released this machine learning infrastructure to the public, to provide more enterprises with reduced costs of computation power, lower barriers to machine learning engineering and deeper developments in AI capabilities.

• Design and develop core pipeline components for the Ark MaaS platform (Model as a Service), supporting API capabilities such as text conversations, multimodal understanding, and multimodal generation.
• Participate deeply in the evolution of cloud-native architectures, including Service Mesh, load balancing (LB), and intelligent routing. Design and implement highly available solutions such as full-link canary releases, traffic degradation, circuit breaking, and rate limiting.
• Optimize system performance for large-model multimodal inference scenarios involving long connections, high throughput, streaming output, and low-latency requirements.
• Ensure system stability under large-scale model invocation scenarios and resolve architectural bottlenecks caused by sudden traffic surges.

Qualifications

• Minimum Qualifications - B. Sc or higher degree in Computer Science or related fields from accredited and reputable institutions with at least 3 years of relevant experience.
• Familiar with developments and operations of distributed systems under Linux platform.
• Proficient with at least 2 or more programming languages such as Golang / Python / C / C++ / Java / Scala / Javascript. ACM ICPC / Codeforces winners are preferred - Excellent in technical design and coding skills. Able to balance technical perspectives with product sense, hardware performance & stability and team cooperation.
• Preferred Qualifications - Understanding of Agent-related concepts and technologies such as Function Calling and MCP; hands‑on experience building Agents is a plus.
• Familiarity with cloud-native and Service Mesh technologies such as Kubernetes, Docker, Istio, and Envoy.
• Strong understanding of multimodal data processing and storage, including image and video/audio data.
• Interest in or practical experience with LLM inference pipelines and large-model engineering systems.

Job Information

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.