ML Infra Engineer Intern: Build Scalable Orchestration

ByteDance; Seattle (WA); On-site; USD 34,000 - 55,000; Full time

Job summary

ByteDance in Seattle is offering an internship with the Data-AML-Engine Orchestration team. You will help build large-scale ML infrastructure, focusing on orchestration, scheduling, and resource management for production workloads across ByteDance products.

You’ll work on systems affecting GPU utilization, latency, reliability, and MLE productivity. Strong emphasis on ownership, collaboration, and hands-on learning in a fast-paced tech environment.

Qualifications

• Pursuing a Bachelor's or Master's degree in CS, SWE, AI, or related field.
• Proficiency in at least one of Go, C++, or Python with strong CS fundamentals.
• Familiarity with Linux and distributed systems concepts.

Responsibilities

• Design and build foundational orchestration capabilities for ML platforms, including Kubernetes Operators and lifecycle management.
• Develop multi-tenant resource and quota systems to improve GPU utilization and cost efficiency.
• Implement serving orchestration for online model deployments, upgrades, autoscaling, and multi-cluster operations.
• Build topology-aware scheduling and traffic management for disaggregated serving clusters.

Skills

Go

C++

Python

Education

Bachelor's or Master's in CS / Software Engineering / AI

Tools

Kubernetes

Container runtimes

Distributed systems

Job description

ByteDance in Seattle is offering an internship with the Data-AML-Engine Orchestration team. You will help build large-scale ML infrastructure, focusing on orchestration, scheduling, and resource management for production workloads across ByteDance products.

You’ll work on systems affecting GPU utilization, latency, reliability, and MLE productivity. Strong emphasis on ownership, collaboration, and hands-on learning in a fast-paced tech environment.