Senior AI Infrastructure Engineer — Compute Efficiency

ByteDance; Seattle (WA); On-site; USD 207,000 - 368,000; Full time

Job summary

ByteDance is seeking a Senior Software Engineer for AI Infrastructure-Compute Efficiency in Seattle. You will design and optimize large-scale Kubernetes-based platforms powering AI/LLM workloads across global clusters, focusing on resource efficiency and performance.

You will improve pod lifecycle and scheduling, build observability and SLOs, and contribute to open-source projects while collaborating with teams worldwide to scale our compute infrastructure in North America, Europe and Asia

Qualifications

• Minimum qualifications: B.S./M.S. in Computer Science, Computer Engineering or related area with 3+ years of experience; Ph.D. can be an exception.
• Solid understanding of Unix/Linux environments, distributed and parallel systems, high-performance networking systems, and large-scale software systems.
• Familiarity with container and orchestration technologies such as Docker and Kubernetes.
• Proficiency in at least one major programming language such as Python, Go, C++, Rust, and Java.
• Preferred: knowledge of big data or ML workflows in a Kubernetes environment.
• Experience contributing to cloud-native open-source projects.

Responsibilities

• Design and evolve the architecture of large-scale Kubernetes-based infrastructure platforms for performance, scalability, and resilience across workloads including AI/LLM apps.
• Improve Kubernetes system performance across control and data planes, optimizing pod lifecycle and resource orchestration under high load.
• Build observability and performance analysis frameworks, define system-level SLOs, and lead data-driven tuning in production.
• Develop intelligent, unified resource management and scheduling for node and cluster resources in cloud-native environments.
• Drive standardization and optimization of container runtimes to improve workload isolation, reliability, and efficiency.

Skills

Unix/Linux environments

Distributed & parallel systems

High-performance networking systems

Large scale software systems

Python

Go

C++

Rust

Java

Education

B.S./M.S. in Computer Science or related field

Tools

Docker

Kubernetes

Job description

ByteDance is seeking a Senior Software Engineer for AI Infrastructure-Compute Efficiency in Seattle. You will design and optimize large-scale Kubernetes-based platforms powering AI/LLM workloads across global clusters, focusing on resource efficiency and performance.

You will improve pod lifecycle and scheduling, build observability and SLOs, and contribute to open-source projects while collaborating with teams worldwide to scale our compute infrastructure in North America, Europe and Asia