ML Systems Engineer: Kubernetes Orchestration & Model Serving

ByteDance; Seattle (WA); On-site; USD 140,000 - 210,000; Full time

Job summary

ByteDance in Seattle is seeking top graduates to join our Technology team. You will design and implement orchestration features for machine learning platforms, including operators, runtimes, and lifecycle management for jobs and services.

You will also build multi-tenant resource and quota systems for priorities and fair sharing across clusters, improving GPU utilization and cost efficiency, and you will lead lifecycle orchestration for online model serving with deployment, upgrades,

Qualifications

• PhD in CS/SE/AI or related field.
• Proficiency in Go, C++, or Python; solid data structures and algorithms.
• Familiarity with Linux and OS concepts; networks and distributed systems.

Responsibilities

• Design and build foundational orchestration capabilities for ML platforms (Kubernetes Operators, containers, lifecycle for jobs/services).
• Build multi-tenant resource and quota systems with priorities, preemption, fairness, and cross-cluster scheduling; optimize GPU utilization and costs.

Skills

Go

C++

Python

Education

PhD in Computer Science / Software Engineering / AI

Job description

ByteDance in Seattle is seeking top graduates to join our Technology team. You will design and implement orchestration features for machine learning platforms, including operators, runtimes, and lifecycle management for jobs and services.

You will also build multi-tenant resource and quota systems for priorities and fair sharing across clusters, improving GPU utilization and cost efficiency, and you will lead lifecycle orchestration for online model serving with deployment, upgrades,