ML Platform Orchestration Intern

ByteDance; San Jose (CA); On-site; USD 51,000 - 73,000; Part time

Job summary

ByteDance’s Data-AML-Engine Orchestration team is seeking interns to help build large-scale machine learning infrastructure that powers online model serving across ByteDance products, including TikTok.

You will contribute to systems affecting GPU utilization, serving latency, reliability, and MLE productivity, with opportunities to focus on orchestration, resource management, and multi-cluster serving in a fast-growing environment.

Qualifications

• Pursuing a Bachelor's or Master's degree in CS/Software Engineering/AI or related field.
• Proficiency in Go, C++, or Python with solid data structures knowledge.
• Familiarity with Linux, OS concepts, networks, concurrency, and distributed systems.
• Strong hands-on and exploratory abilities to interrogate systems via code, metrics, logs, and experiments.
• Systematic, quantitative problem solving with ability to define measurements and test hypotheses.
• Demonstrated ownership and collaboration through coursework, research, internships, or open-source work.

Responsibilities

• Design and build foundational orchestration capabilities for ML platforms (Kubernetes Operators, containers, lifecycle management).
• Develop multi-tenant resource and quota systems to improve GPU utilization and cost efficiency.
• Build lifecycle orchestration for online model serving (distribution, deployment, autoscaling, disaster recovery).
• Develop serving orchestration and traffic management for disaggregated clusters (topology-aware scheduling, QoS/SLA).

Skills

Go

C++

Python

Education

Bachelor's or Master's in Computer Science/Software Engineering/AI

Tools

Kubernetes

Container runtimes

Volcano

Koordinator

OpenKruise

vLLM

SGLang

Triton

KServe

Ray Serve

Job description

ByteDance’s Data-AML-Engine Orchestration team is seeking interns to help build large-scale machine learning infrastructure that powers online model serving across ByteDance products, including TikTok.

You will contribute to systems affecting GPU utilization, serving latency, reliability, and MLE productivity, with opportunities to focus on orchestration, resource management, and multi-cluster serving in a fast-growing environment.