MLSys Backend Engineer Graduate (AML Ark) - 2027 Start

ByteDance; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

ByteDance in Singapore is seeking a talented software engineer to design and develop resource scheduling systems for machine learning platforms, supporting training, evaluation, and inference workloads across NLP, CV, and Speech.

You will optimize the orchestration of GPUs, CPUs, and accelerators, and design workload scheduling across data centers and cloud environments to ensure efficient resource utilization and scalable performance.

Qualifications

• Bachelor's or Master's degree in computing or related field (or equivalent).
• Proficient in Go, Python, or Shell scripting in Linux.
• Strong Kubernetes knowledge and container tech: Docker, Containerd, Kata Containers, Podman.
• Solid understanding of distributed systems, designing and maintaining large-scale distributed systems.

Responsibilities

• Design and develop resource scheduling systems for ML platforms, supporting training, evaluation, and inference workloads across NLP, CV, and Speech.
• Optimize orchestration and scheduling of GPUs, CPUs, and accelerators for multi-cloud resources.
• Develop scheduling solutions for compute, RDMA networking, and storage for large-scale distributed clusters.
• Design workload scheduling across data centers, regions, and cloud environments for online services and batch jobs.

Skills

Go

Python

Shell scripting

Kubernetes

Docker

Containerd

Podman

Distributed systems

Education

Bachelor's or Master's degree in Computing

Tools

Docker

Containerd

Kata Containers

Podman

Job description

Location:

Team:

Employment Type:

Regular

Job Code:

A25263

Share this listing:

Responsibilities

Team IntroductionVolcano Ark is Volcano Engine's one-stop foundation model and Agent platform for enterprises and developers. Our team is building the next-generation infrastructure for general-purpose Agents capable of handling complex tasks—from Agent runtimes and execution engines, to platform-level resource models, lifecycle management, and public APIs, as well as evaluation and observability systems.We are looking for talented individuals to join our team in 2027. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth. Launch your career where inspiration is infinite at ByteDance.Successful candidates must be able to commit to an onboarding date by end of year 2027. Please state your availability and graduation date clearly in your resume.Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to ByteDance and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early.

• Design and develop resource scheduling systems for machine learning platforms, supporting model training, evaluation, and inference workloads across domains such as NLP, Computer Vision (CV), and Speech.
• Optimize the orchestration and scheduling of heterogeneous computing resources, including GPUs, CPUs, and other specialized accelerators, to maximize the utilization of dedicated, opportunistic (spot), co-located, and multi-cloud resources.
• Develop scheduling solutions that optimize the allocation of compute resources, RDMA high-speed networking, and storage resources, enabling large-scale distributed clusters to achieve maximum performance and efficiency.
• Design and implement workload scheduling across multiple data centers, regions, and cloud environments, ensuring balanced resource utilization and efficient placement of both online services and offline batch jobs.

Qualifications

Minimum Qualifications

• Individuals who are completing or have recently completed a Bachelor's/ Master's degree in computing or a related discipline.
• Proficient in one or more programming languages such as Go, Python, or Shell scripting in a Linux environment.
• Strong understanding of the Kubernetes architecture and ecosystem, with hands-on experience in container technologies such as Docker, Containerd, Kata Containers, and Podman. Extensive experience in developing and operating machine learning systems is preferred.
• Solid understanding of distributed systems principles, with experience designing, developing, and maintaining large-scale distributed systems.

Preferred Qualifications

• Familiar with at least one ML framework: TensorFlow / PyTorch
• Hands on with AI Infrastructure，HW/SW Co-Design，High Performance Computing，ML Hardware Architecture (GPU、Accelerators、Networking)

Job Information

About Us

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.