ML Platform Engineer - Orchestration & GPU-Driven Serving

ByteDance

San Jose (CA)

On-site

USD 162,000 - 317,000

Full time

4 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

ByteDance's Data-AML-Engine Orchestration team builds large-scale machine learning infrastructure powering online model serving across ByteDance products, including TikTok. You will design and implement foundational orchestration capabilities, focusing on Kubernetes Operators, container runtimes, and lifecycle management for jobs, services, and stateful workloads.

Join us to optimize GPU utilization, improve latency and reliability, and grow your expertise in distributed systems and FinOps while

Qualifications

PhD or PhD candidate in a related technical field.
Proficiency in Go, C++, or Python with solid CS fundamentals.
Experience with Linux, OS concepts, and distributed systems.
Ability to explore systems via code, metrics, logs, and profiling.
Strong problem-solving with quantifiable measurements.
Demonstrated ownership through projects or internships.

Responsibilities

Design and build foundational orchestration for ML platforms, including Kubernetes Operators and lifecycle management.
Build multi-tenant resource and quota systems to improve GPU utilization and cost efficiency.
Implement lifecycle orchestration for online model serving, including deployment, upgrades, and disaster recovery.
Develop serving orchestration, topology-aware scheduling, and QoS/SLA management.