Graduate ML Systems Engineer - AML Orchestration

Bytedance; San Jose, Northern (CA, KY); Hybrid; USD 162,000 - 317,000; Full time

Benefits offered by this job

Health insurance

401(k) with company match

Parental leave

Disability insurance

Life insurance

Wellbeing benefits

Holiday entitlement

Paid sick days

Paid personal time

Job summary

ByteDance is seeking a Software Engineer Graduate for AML-Engine-Orchestration in San Jose. You will join the Data-AML-Engine Orchestration team building large-scale ML infrastructure powering online model serving across TikTok and other products.

You’ll design and implement orchestration, scheduling, and resource management systems, work on multi-tenant environments, and contribute to GPU utilization, latency, and reliability while onboarding quickly and pursuing bold ideas.

Qualifications

• PhD in Computer Science, Software Engineering, AI or related field.
• Proficiency in Go, C++, or Python with solid CS fundamentals.
• Familiarity with Linux, OS concepts, networks, concurrency and distributed systems.
• Strong hands-on, exploratory mindset and willingness to investigate systems via code, metrics, logs and experiments.
• Structured, quantitative problem solving and ability to define measurements and test hypotheses.
• Demonstrated ownership through coursework, research, internships or open-source work.

Responsibilities

• Design and build foundational orchestration capabilities for ML platforms (Kubernetes operators, container runtimes, lifecycle management).
• Build multi-tenant resource and quota systems for priorities, preemption, fairness, elasticity and cross-cluster scheduling.
• Develop lifecycle orchestration for online model serving (deployment, upgrades, autoscaling, disaster recovery).
• Create serving orchestration and traffic management for disaggregated clusters (topology-aware scheduling, KV Cache affinity, QoS/SLA).

Skills

Go/C++/Python

Linux

Distributed systems

Problem solving

Ownership & collaboration

Education

PhD in CS/AI/SE

Tools

Kubernetes

Container runtimes

Resource scheduling

Job description

ByteDance is seeking a Software Engineer Graduate for AML-Engine-Orchestration in San Jose. You will join the Data-AML-Engine Orchestration team building large-scale ML infrastructure powering online model serving across TikTok and other products.

You’ll design and implement orchestration, scheduling, and resource management systems, work on multi-tenant environments, and contribute to GPU utilization, latency, and reliability while onboarding quickly and pursuing bold ideas.