MLSys Backend Engineer Graduate (AML Ark) - 2027 Start

BYTEDANCE PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

ByteDance Volcano Ark is seeking talented engineers to design and develop resource scheduling systems for ML platforms, enabling training, evaluation, and inference workloads across NLP, CV, and Speech domains. You will optimize orchestration of GPUs, CPUs, and accelerators, and enable efficient allocation of compute, networking, and storage resources across multi-cloud environments.

The role emphasizes building scalable workload scheduling across multiple data centers and regions, ensuring

Qualifications

• Bachelor's or Master's in computing or related discipline.
• Proficient in Go, Python, or Shell scripting in Linux.
• Strong understanding of Kubernetes and container technologies (Docker, Containerd, Kata Containers, Podman).
• Experience in developing and operating machine learning systems; distributed systems principles.

Responsibilities

• Design and develop resource scheduling systems for ML platforms (training, evaluation, inference).
• Optimize orchestration and scheduling of GPUs, CPUs, and accelerators across multi-cloud resources.
• Develop scheduling solutions for compute, RDMA networking, and storage to enable large-scale clusters.
• Design workload scheduling across data centers, regions and clouds for online services and offline batch jobs.

Skills

Go

Python

Shell scripting

Kubernetes

Distributed systems

Education

Bachelor's degree in computing or related field

Master's degree in computing or related field

Tools

Docker

Containerd

Kata Containers

Podman

Job description

Responsibilities

Team Introduction Volcano Ark is Volcano Engine's one-stop foundation model and Agent platform for enterprises and developers. Our team is building the next-generation infrastructure for general-purpose Agents capable of handling complex tasks-from Agent runtimes and execution engines, to platform-level resource models, lifecycle management, and public APIs, as well as evaluation and observability systems. We are looking for talented individuals to join our team in 2027. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth. Launch your career where inspiration is infinite at ByteDance. Successful candidates must be able to commit to an onboarding date by end of year 2027. Please state your availability and graduation date clearly in your resume. Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to ByteDance and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early.

• Design and develop resource scheduling systems for machine learning platforms, supporting model training, evaluation, and inference workloads across domains such as NLP, Computer Vision (CV), and Speech.
• Optimize the orchestration and scheduling of heterogeneous computing resources, including GPUs, CPUs, and other specialized accelerators, to maximize the utilization of dedicated, opportunistic (spot), co-located, and multi-cloud resources.
• Develop scheduling solutions that optimize the allocation of compute resources, RDMA high-speed networking, and storage resources, enabling large-scale distributed clusters to achieve maximum performance and efficiency.
• Design and implement workload scheduling across multiple data centers, regions, and cloud environments, ensuring balanced resource utilization and efficient placement of both online services and offline batch jobs.

Qualifications

Minimum Qualifications: -Individuals who are completing or have recently completed a Bachelor's/ Master's degree in computing or a related discipline.

• Proficient in one or more programming languages such as Go, Python, or Shell scripting in a Linux environment.
• Strong understanding of the Kubernetes architecture and ecosystem, with hands-on experience in container technologies such as Docker, Containerd, Kata Containers, and Podman. Extensive experience in developing and operating machine learning systems is preferred.
• Solid understanding of distributed systems principles, with experience designing, developing, and maintaining large-scale distributed systems.

Preferred Qualifications: -Familiar with at least one ML framework: TensorFlow / PyTorch -Hands on with AI Infrastructure,HW/SW Co-Design,High Performance Computing,ML Hardware Architecture (GPU,Accelerators,Networking)

• Familiar with at least one ML framework: TensorFlow / PyTorch
• Hands on with AI Infrastructure,HW/SW Co-Design,High Performance Computing,ML Hardware Architecture (GPU,Accelerators,Networking)

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.