Senior AI Infra Engineer: Compute Efficiency & Scale

ByteDance; San Jose (CA); On-site; USD 218,000 - 480,000; Full time

Job summary

ByteDance in San Jose is hiring a Senior Software Engineer to optimize the Compute Infrastructure for AI/LLM workloads. You will design scalable Kubernetes-based platforms, improve runtime performance, and build observability tools to drive data‑driven decisions.

The role emphasizes high‑performance computing, resource management, and reliability across global clusters, with opportunities to influence overseas expansion and open‑source initiatives.

Qualifications

• BS/MS in Computer Science, Computer Engineering or a related field; 3+ years of relevant experience.
• Familiarity with container/orchestration technologies such as Docker and Kubernetes.
• Proficiency in at least one major programming language (Python, Go, C++, Rust or Java).

Responsibilities

• Design and evolve architecture of large-scale Kubernetes-based infrastructure platforms for diverse workloads, including AI/LLM apps.
• Improve Kubernetes system performance across control and data planes under high load.
• Build observability and performance analysis frameworks; define and tune SLOs in production.
• Develop unified resource management and scheduling systems for large-scale cloud-native environments.

Skills

Python

Go

C++

Rust

Java

Education

B.S./M.S. in Computer Science or related

Tools

Docker

Kubernetes

Job description

ByteDance in San Jose is hiring a Senior Software Engineer to optimize the Compute Infrastructure for AI/LLM workloads. You will design scalable Kubernetes-based platforms, improve runtime performance, and build observability tools to drive data‑driven decisions.

The role emphasizes high‑performance computing, resource management, and reliability across global clusters, with opportunities to influence overseas expansion and open‑source initiatives.