ML Infrastructure Engineer Intern

ByteDance

Seattle (WA)

On-site

USD 33,000 - 50,000

Part time

3 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

ByteDance is seeking a motivated intern for the Data-AML-Engine Orchestration team in Seattle to help build large-scale ML infrastructure. You will work on orchestration, scheduling, and resource management that connect heterogeneous compute with production ML workloads, influencing GPU utilization, latency, and reliability.

You will explore Kubernetes Operators, multi-tenant scheduling, and online model serving, collaborating with engineers across teams.

Qualifications

Pursuing Bachelor's or Master's in CS, SE, AI, or related field.
Proficiency in Go, C++, or Python with solid CS fundamentals.
Familiar with Linux and OS concepts, networks, concurrency, and distributed systems.
Hands-on and exploratory mindset with ability to analyze systems via code, metrics, logs, profiling, and experiments.
Systematic and quantitative problem solving with ability to define measurements and validate improvements.
Demonstrated ownership through coursework, internships, OSS, or other projects.

Responsibilities

Design and build orchestration features for ML platforms, including Kubernetes Operators and lifecycle management for jobs and services.
Build multi-tenant resource and quota systems to improve GPU utilization and cost efficiency.
Develop serving orchestration for online model deployment, upgrades, autoscaling, and disaster recovery.
Contribute to topology-aware scheduling, KV caching, intelligent routing, and QoS/SLA management.