Infrastructure Intern: Distributed ML Systems & RL

ByteDance; Seattle (WA); On-site; USD 94,000 - 127,000; Part time

Job summary

ByteDance Seed is seeking an Infrastructure Intern to help design and optimize distributed training and inference for AI foundation models. You will work across data/model/pipeline parallelism, memory efficiency, and fault tolerance to advance large-scale AI systems.

You will contribute to reinforcement learning training frameworks and compiler/runtime optimizations for heterogeneous hardware. Ideal candidates are PhD students with strong Python/C++ skills and a solid background in systems and

Qualifications

• Pursuing a PhD in Computer Science, Electrical Engineering, or related fields.
• Strong programming skills in Python and/or C++.
• Solid understanding of systems, distributed computing, and ML systems.

Responsibilities

• Design and optimize large-scale distributed training systems (data/model/pipeline parallelism, memory efficiency, fault tolerance).
• Contribute to reinforcement learning training frameworks and large-scale post-training systems.
• Improve inference performance, latency, and throughput for foundation models.
• Develop compiler or runtime optimizations for heterogeneous hardware (GPU/accelerator).
• Work on system-level performance analysis, profiling, and bottleneck diagnosis.
• Build tooling and automation to improve developer productivity and system reliability.

Skills

Python

C++

Distributed systems

ML systems

Performance optimization

Education

PhD in CS/EE or related

Tools

CUDA

Triton

PyTorch FSDP

Job description

ByteDance Seed is seeking an Infrastructure Intern to help design and optimize distributed training and inference for AI foundation models. You will work across data/model/pipeline parallelism, memory efficiency, and fault tolerance to advance large-scale AI systems.

You will contribute to reinforcement learning training frameworks and compiler/runtime optimizations for heterogeneous hardware. Ideal candidates are PhD students with strong Python/C++ skills and a solid background in systems and