MLSys Backend Engineer Graduate (AML Ark) - 2027 Start

BYTEDANCE PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

ByteDance's Volcano Ark team seeks engineers to design and develop resource scheduling for ML platforms, handling training, evaluation, and inference workloads across NLP, CV, and speech domains.

You will optimize resource orchestration for GPUs, CPUs, and accelerators, enabling large-scale distributed clusters with efficient placement across data centers and clouds.

Qualifications

• Bachelor's/Master's degree in computing or related field.
• Proficient in Go, Python, or Shell in Linux.
• Strong understanding of Kubernetes; experience with container tech is preferred.
• Solid understanding of distributed systems principles and large-scale systems.

Responsibilities

• Design and develop resource scheduling systems for ML platforms and workloads.
• Optimize orchestration and scheduling of GPUs, CPUs, and accelerators across multi-clouds.
• Develop scheduling solutions for compute, RDMA networking, and storage in large clusters.
• Design workload scheduling across multiple data centers and cloud environments.

Skills

Go

Python

Shell scripting

Kubernetes

Docker

Containerd

Kata Containers

Podman

Distributed systems

Education

Bachelor's or Master's in computing or related

Tools

Docker

Containerd

Kata Containers

Podman

Kubernetes

Job description

Responsibilities

Team IntroductionVolcano Ark is Volcano Engine's one-stop foundation model and Agent platform for enterprises and developers. Our team is building the next-generation infrastructure for general-purpose Agents capable of handling complex tasks—from Agent runtimes and execution engines, to platform-level resource models, lifecycle management, and public APIs, as well as evaluation and observability systems.We are looking for talented individuals to join our team in 2027. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth. Launch your career where inspiration is infinite at ByteDance.Successful candidates must be able to commit to an onboarding date by end of year 2027. Please state your availability and graduation date clearly in your resume.Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to ByteDance and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early.

• Design and develop resource scheduling systems for machine learning platforms, supporting model training, evaluation, and inference workloads across domains such as NLP, Computer Vision (CV), and Speech.
• Optimize the orchestration and scheduling of heterogeneous computing resources, including GPUs, CPUs, and other specialized accelerators, to maximize the utilization of dedicated, opportunistic (spot), co-located, and multi-cloud resources.
• Develop scheduling solutions that optimize the allocation of compute resources, RDMA high-speed networking, and storage resources, enabling large-scale distributed clusters to achieve maximum performance and efficiency.
• Design and implement workload scheduling across multiple data centers, regions, and cloud environments, ensuring balanced resource utilization and efficient placement of both online services and offline batch jobs.

Qualifications

Minimum Qualifications:

• Individuals who are completing or have recently completed a Bachelor's/ Master's degree in computing or a related discipline.
• Proficient in one or more programming languages such as Go, Python, or Shell scripting in a Linux environment.
• Strong understanding of the Kubernetes architecture and ecosystem, with hands-on experience in container technologies such as Docker, Containerd, Kata Containers, and Podman. Extensive experience in developing and operating machine learning systems is preferred.
• Solid understanding of distributed systems principles, with experience designing, developing, and maintaining large-scale distributed systems.

Preferred Qualifications:

• Familiar with at least one ML framework: TensorFlow / PyTorch
• Hands on with AI Infrastructure，HW/SW Co-Design，High Performance Computing，ML Hardware Architecture (GPU、Accelerators、Networking)

Job Information

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.