Backend Engineer - Machine Learning Storage Infra (Singapore)

BYTEDANCE PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

ByteDance is hiring for an experienced software engineer to design and optimize distributed systems powering its AI infrastructure and recommendation platforms. The role focuses on building a unified platform capable of supporting diverse, high-throughput workloads across ads, search, live, and e-commerce ranking.

You will work on multi-tier storage architectures, resource scheduling, and ML workflows, collaborating with teams to improve performance, scalability, and reliability.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or related field.
• Proficient in C++ and Python in Linux environments.
• Strong understanding of distributed systems principles and hands-on optimization of large-scale distributed systems.

Responsibilities

• Design and build a unified platform/middleware system to support diverse business requirements across scenarios.
• Plan and optimize utilization of large volumes of heterogeneous resources across data centers and service tiers.
• Develop automated and dynamic optimization strategies based on changes in model size, service traffic, and workloads.
• Keep up with advances in software and hardware architectures and evaluate emerging technologies.

Skills

C++

Python

Distributed systems

Education

Bachelor's degree in CS or related

Tools

Mooncake

Redis

RocksDB

MongoDB

HDFS

Ceph

Job description

Responsibilities

• The mission of our AML team is to push the next-generation AI infrastructure and recommendation platform for the ads ranking, search ranking, live & e-Commerce ranking in our company. We also drive substantial impact on core businesses of the company.
• Design and build a unified platform/middleware system that can support diverse business requirements across different scenarios, including low cost, high availability, high throughput, high performance, and large-scale storage capacity.
• Design and optimize complex multi-tier storage architectures beyond GPU memory, CPU memory, and external storage, with a focus on efficient data placement and resource utilization.
• Keep up with the latest advances in software and hardware architectures, and proactively evaluate and experiment with emerging technologies.

• As an internal platform serving multiple teams, plan and optimize the utilization of large volumes of heterogeneous resources across multiple hardware generations, data centers, service tiers, and resource pools. Develop automated and dynamic optimization strategies based on changes in model size, service traffic, and workload characteristics.

Qualifications

Minimum Qualification(s)

• Bachelor's degree or above in Computer Science, Software Engineering, or a related field
• Proficient in C++ and Python programming in Linux environments.
• Strong understanding of distributed systems principles, with hands-on experience in the design, development, maintenance, and continuous optimization of large-scale distributed systems.

Able to identify potential issues and bottlenecks in complex distributed systems.

• Experience working on distributed systems in areas such as recommendation, search, or machine learning, with exposure to resource scheduling, task orchestration, model training, model inference, feature extraction, ML Systems (MLSys), or AIOps.
• Strong logical and analytical thinking skills, with the ability to abstract and decompose complex business and technical requirements effectively.

Strong teamwork and collaboration skills.

Preferred Qualification(s)

• Experience optimizing systems similar to Parameter Server, or optimizing indexing structures in large-scale search systems.
• Experience with KV Cache systems, such as Mooncake, including system optimization and performance tuning and with mainstream machine learning frameworks such as TensorFlow, PyTorch, or MXNet.
• Familiarity with open-source storage systems such as Redis, LevelDB/RocksDB, and MongoDB, or hands-on experience using or optimizing large-scale distributed storage systems such as HDFS or Ceph.

Job Information

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.