Software Engineer, AI Infrastructure

ByteDance; Singapore; On-site; SGD 180,000 - 260,000; Full time

Job summary

ByteDance is seeking engineers to advance a highly available, scalable general-purpose Serverless platform (FaaS) with one-click function creation and deployment. You'll work on a world-class system handling 100M+ QPS, building AI agent ecosystems, secure sandboxing, and multi-region disaster recovery.

Join a fast-paced, innovative team dedicated to reducing developers' burdens through secure, efficient serverless computing and cost optimization for enterprise users.

Qualifications

• Strong programming fundamentals and at least one listed language.
• Hands-on with large-scale distributed systems in production.
• Cloud native experience with Kubernetes, Knative, Firecracker or similar.
• Familiarity with serverless platforms such as AWS Lambda or Google Cloud Functions.

Responsibilities

• Develop AI agent ecosystems and framework components for multi-agent collaboration.
• Design and build secure sandbox infrastructure for large model inference and training.
• Enhance and scale the FaaS platform for usability, scalability, and cost optimization.
• Architect disaster recovery and multi-region fault-tolerant systems for NoOps.
• Investigate cold start optimization across large-scale serverless workloads.

Skills

Go

Python

Java

Node.js

Rust

C

Tools

Kubernetes

Knative

Firecracker

AWS Lambda

Google Cloud Functions

Job description

Responsibilities

Team Introduction
Our team is dedicated to building a highly available and scalable general-purpose Serverless platform that embodies the philosophy of Function-as-a-Service (FaaS). By enabling one-click function creation and deployment while abstracting infrastructure and operational complexities, we significantly reduce developers' burdens in both development and maintenance. Leveraging lightweight function execution and rapid startup capabilities, our platform dynamically scales functions to optimize resource utilization and costs. Currently handling 100M+ QPS, our architecture and product scale are industry-leading. We seek innovative, passionate engineers with experience in high-availability systems to join us in pioneering the future of serverless computing.

• Develop AI Agent Ecosystems: Contribute to designing and building AI agent frameworks, tool integration systems, and multi-agent collaboration platforms.
• Design Secure Sandbox Infrastructure: Lead the development of sandbox technologies to support secure and efficient large model inference and training workloads.
• Enhance Serverless Platform: Drive the design and evolution of our FaaS platform, focusing on usability, scalability, and cost optimization for enterprise users.
• Build Global High-Availability Architecture: Architect automated disaster recovery and fault tolerance mechanisms across multi-cluster and multi-region environments to achieve NoOps capabilities.
• Optimize Cold Start Performance: Innovate solutions for large-scale cold start scenarios, delivering multi-layered optimization to meet the demanding requirements of serverless functions.

Qualifications

Minimum Qualifications:

• - Strong Programming Fundamentals: Proficiency in algorithms, data structures, and at least one programming language (Go, Python, Java, Node.js, Rust, C).
• - Distributed Systems Expertise: Hands-on experience with large-scale distributed systems, including system modeling and problem-solving in production environments.
• - Cloud Native Experience: Familiarity with Kubernetes, Knative, Firecracker, or similar open-source projects.
• - Serverless Product Knowledge: Experience with AWS Lambda, Google Cloud Functions, or equivalent platforms.

Preferred Qualifications:

• - Familiarity with containerization, networking, and distributed tracing.

If you're passionate about pushing the boundaries of serverless computing and thrive in fast-paced, innovative environments, we want to hear from you!

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.