Cloud AI Systems Research Intern (PhD, Summer 2027)

Bytedance; San Jose (CA); On-site; USD 100,000 - 145,000; Part time

Job summary

ByteDance's DPU team in San Jose is offering a 12-week PhD internship in cloud and AI infrastructure. You will design and build large-scale, container-based cluster management and orchestration systems with a focus on performance and resilience.

You will collaborate across teams to advance ML inference platforms, work with vLLM, TensorRT-LLM, and related engines, and stay current with Kubernetes, Ray, and open-source tooling.

Qualifications

• PhD candidate in a related technical field.
• Availability for a 12-week Summer 2027 internship.

Responsibilities

• Design and build large-scale, container-based cluster management and orchestration systems with extreme performance, scalability, and resilience.
• Architect next-generation cloud-native GPU and AI accelerator infrastructure for cost-efficient ML platforms.
• Collaborate across teams to deliver world-class inference solutions using vLLM, SGLang, TensorRT-LLM, and other engines.
• Stay current with Kubernetes, Ray and open-source practices; apply them to production systems.
• Write high-quality, maintainable, testable code for production environments.

Skills

Large model inference

Distributed systems

High-performance networking

Go

Rust

Python

C++

Education

PhD in CS/CE/EE

Tools

Docker

Kubernetes

Job description

ByteDance's DPU team in San Jose is offering a 12-week PhD internship in cloud and AI infrastructure. You will design and build large-scale, container-based cluster management and orchestration systems with a focus on performance and resilience.

You will collaborate across teams to advance ML inference platforms, work with vLLM, TensorRT-LLM, and related engines, and stay current with Kubernetes, Ray, and open-source tooling.