Software Engineer, AI Infrastructure

ByteDance; Singapore; On-site; SGD 150,000 - 230,000; Full time

Job summary

ByteDance is hiring engineers to build a highly available, scalable serverless platform (FaaS) that enables one-click function creation and deployment while abstracting infrastructure complexities. The team handles 100M+ QPS and seeks talent experienced in high-availability systems to push the boundaries of serverless computing.

Role involves developing AI agent ecosystems, designing secure sandbox infrastructure, and evolving the FaaS platform for enterprise usability and cost optimization,

Qualifications

• Strong programming fundamentals with knowledge of standard data structures and algorithms.
• Experience with distributed systems and operating at scale in production environments.
• Familiarity with cloud-native tools and serverless platforms.

Responsibilities

• Develop AI agent ecosystems and multi-agent collaboration platforms.
• Design secure sandbox infrastructure for large model inference and training workloads.
• Enhance the serverless platform focusing on usability, scalability, and cost optimization for enterprise users.
• Build global high-availability architecture with disaster recovery across multi-cluster regions.
• Optimize cold start performance for large-scale serverless functions.

Skills

Go

Python

Java

Node.js

Rust

C

Tools

Kubernetes

Knative

Firecracker

AWS Lambda

Google Cloud Functions

Job description

Responsibilities

Team Introduction

Our team is dedicated to building a highly available and scalable general-purpose Serverless platform that embodies the philosophy of Function-as-a-Service (FaaS). By enabling one-click function creation and deployment while abstracting infrastructure and operational complexities, we significantly reduce developers' burdens in both development and maintenance. Leveraging lightweight function execution and rapid startup capabilities, our platform dynamically scales functions to optimize resource utilization and costs. Currently handling 100M+ QPS, our architecture and product scale are industry-leading. We seek innovative, passionate engineers with experience in high-availability systems to join us in pioneering the future of serverless computing.

Responsibilities

• Develop AI Agent Ecosystems: Contribute to designing and building AI agent frameworks, tool integration systems, and multi-agent collaboration platforms.


• Design Secure Sandbox Infrastructure: Lead the development of sandbox technologies to support secure and efficient large model inference and training workloads.


• Enhance Serverless Platform: Drive the design and evolution of our FaaS platform, focusing on usability, scalability, and cost optimization for enterprise users.


• Build Global High-Availability Architecture: Architect automated disaster recovery and fault tolerance mechanisms across multi-cluster and multi-region environments to achieve NoOps capabilities.


• Optimize Cold Start Performance: Innovate solutions for large-scale cold start scenarios, delivering multi-layered optimization to meet the demanding requirements of serverless functions.

Qualifications

Minimum Qualifications:

• Strong Programming Fundamentals: Proficiency in algorithms, data structures, and at least one programming language (Go, Python, Java, Node.js, Rust, C).


• Distributed Systems Expertise: Hands-on experience with large-scale distributed systems, including system modeling and problem-solving in production environments.


• Cloud Native Experience: Familiarity with Kubernetes, Knative, Firecracker, or similar open-source projects.


• Serverless Product Knowledge: Experience with AWS Lambda, Google Cloud Functions, or equivalent platforms.

Preferred Qualifications:

• Familiarity with containerization, networking, and distributed tracing.

If you're passionate about pushing the boundaries of serverless computing and thrive in fast-paced, innovative environments, we want to hear from you!

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an \"Always Day 1\" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.