Backend Inference Framework Engineer Graduate (AML Inference) - 2027 Start

United States Digital Space LLC; Singapore; On-site; SGD 55,000 - 90,000; Full time

Job summary

United States Digital Space LLC is seeking talented individuals to join the Backend team in Singapore in 2027. The role focuses on building a high-performance, scalable enterprise inference system for large AI models, with emphasis on C/C++ development and Linux proficiency.

You will work on R&D for core modules, including inference engine scheduling, monitoring, canary releases, and performance tuning in concurrent environments, while collaborating across teams to drive robust technical

Qualifications

• Bachelor's or master's degree in computing or related field.
• Proficient in Linux basics and C/C++ programming.
• Solid knowledge of data structures and algorithms.
• Experience with multi-threaded concurrency and performance tuning.
• Experience in high-concurrency distributed services and latency optimization.
• Strong problem analysis, abstraction, and learning abilities.
• Excellent cross-team collaboration, communication, and documentation skills.

Responsibilities

• Architect and implement high-performance model inference services for large-parameter AI models.
• R&D and optimization of core inference framework modules (scheduling, monitoring, canary releases).
• Track latest inference technologies and promote standardization across the team.

Skills

C/C++ programming

Linux commands

Data structures & algorithms

Multi-threading

Performance tuning

Distributed services

Problem solving

Cross-team collaboration

Documentation

Education

Bachelor's/Master's degree in computing

Tools

Redis

RocksDB

BRPC

GRPC

GPUs knowledge

Job description

Location:

Singapore

Team:

Backend

Employment Type:

Regular

Job Code:

A106244

Responsibilities

Team IntroductionData AML is the company's Machine Learning mid-platform, providing training and inference systems for recommendation/advertising for businesses such as Douyin, Jinri Toutiao, and Xigua Video. It provides powerful Machine Learning computing power for internal business units within the company and conducts research on some general and innovative algorithms for issues in these businesses.

We are looking for talented individuals to join our team in 2027. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth. Launch your career where inspiration is infinite at the company.

Successful candidates must be able to commit to an onboarding date by end of year 2027. Please state your availability and graduation date clearly in your resume.

Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to the company and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early.

Responsibilities

• Responsible for the overall architecture design and implementation of model inference services, building a high-performance, highly available, and scalable enterprise-level inference system for large-parameter, high-complexity AI models, overcoming various architectural challenges in the implementation of complex model inference, and supporting the efficient launch of models across all business scenarios.
• Responsible for the R&D and optimization of the core modules of the inference framework, covering core capabilities such as inference engine scheduling, monitoring and alerting, canary release, etc., continuously iterating on the framework performance, and resolving performance bottlenecks, resource bottlenecks, and stability issues in high-concurrency and large-model inference scenarios.
• Keep track of the latest inference technologies in the industry, conduct technology selection and innovation in combination with business scenarios, accumulate distributed high-concurrency service architecture solutions, and promote the upgrade and standardization of the team's technical system.

Qualifications

Minimum Qualifications:

• Individuals who are completing or have recently completed a Bachelor's/ Master's degree in computing or a related discipline.
• Familiar with basic Linux commands, with solid C/C++ programming skills and knowledge of data structures and algorithms
• Familiar with the basic principles of multi-threaded concurrency, proficient in basic usages such as thread usage, synchronization locks, and thread pools, able to identify common concurrency issues, and possess the ability to perform basic performance tuning in multi-threaded scenarios
• Have experience in R&D projects of high-concurrency distributed services, and be familiar with service latency and resource optimization
• Possess good learning and execution abilities, be willing to proactively understand the model inference service architecture, and have problem analysis and abstraction capabilities
• Possess good cross-team collaboration skills, communication and presentation skills, and document writing skills, have strong sense of responsibility and stress tolerance, and be able to drive the resolution of complex technical issues and the implementation of projects

Preferred Qualifications:

• Have practical project experience and understanding of source code in high-concurrency services/frameworks such as Redis, RocksDB, BRPC, GRPC, etc.
• Understand the operating mechanism of GPUs, and have relevant project experience and optimization capabilities in GPU service resource management and control

Job Information

About Us

Founded in 2012, the company's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, the company has made it easier and more fun for people to connect with, consume, and create content.

Why Join the company

Inspiring creativity is at the core of the company's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

the company is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At the company, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.