Senior Software Engineer, Compute Orchestration & ML Scheduling

ByteDance; San Jose (CA); On-site; USD 156,000 - 387,600; Full time

Benefits offered by this job

Medical insurance

401(k) plan with company match

Parental leave

Disability insurance

Life insurance

Wellbeing benefits

10 paid holidays per year

10 paid sick days per year

Paid Personal Time

Job summary

ByteDance in San Jose seeks a Senior Software Engineer for Compute Infrastructure (Orchestration & Scheduling). You will scale and enhance Kubernetes-based systems, designing a unified scheduler for diverse workloads across global data centers.

You will also build AI-driven scheduling to optimize CPU/GPU, memory and power usage, and drive next-gen ML compute platforms for fast, reliable ML/LLM training and inference.

Qualifications

• BS/MS in Computer Science, Computer Engineering or related field with 3+ years of experience; PhD with strong publications may qualify
• Solid understanding of Unix/Linux environments, distributed and parallel systems, or high-performance networking

Responsibilities

• Engineer hyper-scale cluster management to improve Kubernetes-based platforms
• Innovate on core scheduling for containers, VMs, AI/ML workloads
• Develop an intelligent scheduling system using AI to optimize performance and resource use
• Lead infrastructure for next-gen ML workloads, ML training/inference
• Deliver high-quality, maintainable code and stay current with open-source and research advancements

Skills

Python

Go

C++

Rust

Java

Unix/Linux

Kubernetes

Docker

Education

Bachelor's or Master’s in CS/CE

Tools

Docker

Kubernetes

Job description

ByteDance in San Jose seeks a Senior Software Engineer for Compute Infrastructure (Orchestration & Scheduling). You will scale and enhance Kubernetes-based systems, designing a unified scheduler for diverse workloads across global data centers.

You will also build AI-driven scheduling to optimize CPU/GPU, memory and power usage, and drive next-gen ML compute platforms for fast, reliable ML/LLM training and inference.