ML Platform Engineer Intern

ByteDance; San Jose (CA); On-site; USD 51,000 - 73,000; Part time

Benefits offered by this job

Housing allowance

Job summary

ByteDance in California is offering a Data-AML-Engine Orchestration internship to contribute to large-scale ML infrastructure that powers online model serving across ByteDance products.

You will work on orchestration, scheduling, and resource management across heterogeneous compute environments, with hands-on opportunities to improve GPU utilization and latency. This campus internship advances your practical skills and professional growth.

Qualifications

• Pursuing a Bachelor's or Master's degree in Computer Science, Software Engineering, AI, or related field.
• Proficiency in Go, C++, or Python with strong data structures and algorithms.
• Familiarity with Linux and OS basics, networks, concurrency, and distributed systems.
• Strong hands-on, exploratory abilities to investigate systems via code, metrics, logs, and experiments.
• Systematic, quantitative problem solving with the ability to measure and test improvements.
• Evidence of ownership and collaboration through coursework, research, internships, or open-source projects.

Responsibilities

• Design and build foundational orchestration capabilities for ML platforms (Kubernetes Operators, containers, lifecycle management).
• Build multi-tenant resource and quota systems for priorities, preemption, and cross-cluster scheduling to improve GPU utilization and cost efficiency.
• Develop lifecycle orchestration for online model serving (distribution, deployment, upgrades, autoscaling, disaster recovery).
• Create serving orchestration and traffic management for disaggregated clusters (topology-aware scheduling, KV Cache affinity, QoS/SLA).

Skills

Go/C++/Python

Linux basics

Distributed systems

Code exploration

Ownership & collaboration

Education

Bachelor's or Master's in Computer Science/Software Engineering/AI

Tools

Kubernetes

Container runtimes

KServe/Triton

Open source infra (Kubernetes/Volcano/Koordinator/OpenKruise)

vLLM/Ray Serve

Job description

ByteDance in California is offering a Data-AML-Engine Orchestration internship to contribute to large-scale ML infrastructure that powers online model serving across ByteDance products.

You will work on orchestration, scheduling, and resource management across heterogeneous compute environments, with hands-on opportunities to improve GPU utilization and latency. This campus internship advances your practical skills and professional growth.