Intern: AI Inference & Cloud Infrastructure

ByteDance; San Jose (CA); Hybrid; USD 16,531,000 - 23,144,000; Full time

Job summary

ByteDance in San Jose is offering an internship in the Technology team. The role focuses on building scalable cloud and AI computing infrastructure, with hands-on work on container-based systems and GPU/AI accelerator platforms.

The ideal candidate is pursuing a PhD and can commit to a 12-week Summer 2027 program, with strong knowledge of large model inference, distributed systems, and container tech like Docker and Kubernetes.

Qualifications

• Currently pursuing a PhD in CS/CE/EE or related field.
• Commit for 12 weeks during Summer 2027.
• Strong background in large model inference and distributed systems.
• Hands-on experience building cloud/ML infrastructure (resource mgmt, scheduling, routing, monitoring).
• Knowledge of containers and orchestration tech (Docker, Kubernetes).
• Proficiency in Go, Rust, Python, or C++.

Responsibilities

• Design and build large-scale, container-based cluster management and orchestration systems.
• Architect cloud-native GPU/AI accelerator infra for cost-efficient ML platforms.
• Collaborate across teams on inference solutions with various LLM engines.
• Stay current with open source and AI/ML infra; apply best practices.
• Write high-quality, production-ready, scalable code.

Skills

Large model inference

Distributed systems

High-performance networking

Go / Rust / Python / C++

Education

PhD in CS/CE/EE or related

Tools

Docker

Kubernetes

Job description

ByteDance in San Jose is offering an internship in the Technology team. The role focuses on building scalable cloud and AI computing infrastructure, with hands-on work on container-based systems and GPU/AI accelerator platforms.

The ideal candidate is pursuing a PhD and can commit to a 12-week Summer 2027 program, with strong knowledge of large model inference, distributed systems, and container tech like Docker and Kubernetes.