Student Researcher (Doubao (Seed) - Machine Learning System) - 2025 Start (PhD)

ByteDance; Seattle (WA); On-site; USD 60,000 - 80,000; Full time

Job summary

A leading tech company is seeking a Student Researcher for 2025 to join their Machine Learning Systems team in Seattle. This role focuses on developing efficient systems and optimizing machine learning models, offering PhD students exceptional hands-on experience in a rapidly advancing field. Candidates will help drive innovative research while collaborating with top experts as part of their groundbreaking initiatives in AI and machine learning.

Qualifications

• Currently in a PhD program focused on computing principles.
• Familiar with recent advances in network and hardware technologies.
• Expert in at least one programming language in Linux environment (C/C++, CUDA, Python).

Responsibilities

• Research and develop efficient machine learning systems.
• Develop a state-of-the-art asynchronous training framework.
• Implement both general purpose and model specific optimizations.

Skills

Machine Learning Algorithms

Programming Languages

Distributed Systems

Parallel Computing

Education

PhD in Distributed, Parallel Computing

Tools

PyTorch

Jax

Job description

Student Researcher (Doubao (Seed) - Machine Learning System) - 2025 Start (PhD)

Join to apply for the Student Researcher (Doubao (Seed) - Machine Learning System) - 2025 Start (PhD) role at ByteDance

Student Researcher (Doubao (Seed) - Machine Learning System) - 2025 Start (PhD)

3 days ago Be among the first 25 applicants

Join to apply for the Student Researcher (Doubao (Seed) - Machine Learning System) - 2025 Start (PhD) role at ByteDance

Responsibilities

The AML Machine Learning Systems team provides E2E machine learning experience and machine learning resources for the company. The team builds heterogeneous ML training and inference systems based on GPU and AI chips and advances the state-of-the-art of ML systems technology to accelerate and stablize training of models such as stable diffusion and LLM. The team is also responsible for research and development of hardware acceleration technologies for AI and cloud computing, via technologies such as distributed systems, commnucation compression and quantization. The team is reinventing the ML infra for large scale language models. We have published papers at top tier conferences such as ICML, NSDI, EuroSys, OSDI, SOSP, MLSys, NeurIPS, etc.

Responsibilities

The AML Machine Learning Systems team provides E2E machine learning experience and machine learning resources for the company. The team builds heterogeneous ML training and inference systems based on GPU and AI chips and advances the state-of-the-art of ML systems technology to accelerate and stablize training of models such as stable diffusion and LLM. The team is also responsible for research and development of hardware acceleration technologies for AI and cloud computing, via technologies such as distributed systems, commnucation compression and quantization. The team is reinventing the ML infra for large scale language models. We have published papers at top tier conferences such as ICML, NSDI, EuroSys, OSDI, SOSP, MLSys, NeurIPS, etc.

We are looking for talented individuals to join us for a Student Researcher opportunity in 2025. Student Researcher opportunities at ByteDance aim to offer students industry exposure and hands-on experience. Turn your ambitions into reality as your inspiration brings infinite opportunities at ByteDance.

The Student Researcher position provides unique opportunities that go beyond the constraints of our standard internship program, allowing for flexibility in duration, time commitment, and location of work.

Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to ByteDance and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early.

Responsibilities

• Research and develop our efficient machine learning systems, including efficient optimizers, parameters, and gradient efficient training with rank reduction and communication compression.
• Develop a state-of-the-art asynchronous training framework ensuring convergence.
• Implement both general purpose training framework features and model specific optimizations (e.g. LLM, diffusions).
• Improve efficiency and stability for extremely large scale distributed training jobs.
  
  

Qualifications

Minimum Qualifications

• Currently in PhD program in distributed, parallel computing principles and know the recent advances in computing, storage, networking, and hardware technologies
• Familiar with machine learning algorithms, platforms and frameworks such as PyTorch and Jax.
• Have basic understanding of how GPU and/or ASIC works.
• Expert in at least one or two programming languages in Linux environment: C/C++, CUDA, Python.
• Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment.
  
  

Preferred Qualifications

The following experiences will be a big plus:

• GPU based high performance computing, RDMA high performance network (MPI, NCCL, ibverbs).
• Distributed training framework optimizations such as DeepSpeed, FSDP, Megatron, GSPMD.
• AI compiler stacks such as torch.fx, XLA and MLIR.
• Large scale data processing and parallel computing.
• Experiences in designing and operating large scale systems in cloud computing or machine learning.
• Experiences in in-depth CUDA programming and performance tuning (cutlass, triton).
  
  

By submitting an application for this role, you accept and agree to our global applicant privacy policy, which may be accessed here: https://jobs.bytedance.com/en/legal/privacy.

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request

Seniority level

• Seniority level

  Internship

Employment type

• Employment type

  Internship

Job function

• Job function

  Other

• Industries

  Software Development

Referrals increase your chances of interviewing at ByteDance by 2x

Get notified about new Machine Learning Researcher jobs in Seattle, WA.

Bellevue, WA $230,000.00-$300,000.00 2 weeks ago

Bioinformatics Scientist I – AI Applications

Seattle, WA $90,900.00-$112,400.00 2 months ago

Senior Researcher: Artificial General Intelligence (Natural Language Processing)

Senior Machine Learning Engineering Manager

Seattle, WA $168,200.00-$340,100.00 10 hours ago

Senior Machine Learning Engineering Manager

Seattle, WA $106,900.00-$160,400.00 5 hours ago

Senior Machine Learning Engineering Manager -- Teamwork Graph

Seattle, WA $137,049.00-$191,868.59 5 days ago

GenAI Security Researcher, Artificial General Intelligence

Bellevue, WA $165,000.00-$298,800.00 2 days ago

Senior TPM- Enterprise Personalization, Recommendations, GenerativeAI, Machine Learning, Enterprise P13N

Seattle, WA $133,900.00-$231,400.00 2 weeks ago

Postdoctoral Researcher, Fundamental AI Research (PhD)

Seattle, WA $117,000.00-$173,000.00 5 days ago

Seattle, WA $137,049.00-$191,868.59 1 week ago

Postdoctoral Researcher, Fundamental AI Research (PhD)

Bellevue, WA $117,000.00-$173,000.00 5 days ago

Senior Data Scientist, Optimal Sourcing Systems, Sourcing Strategy & Execution Science

Senior Researcher – Multimodal AI – Microsoft Research AI Frontiers

Redmond, WA $119,800.00-$258,000.00 51 minutes ago

Senior ML Engineer, Applied Machine Learning

Seattle, WA $100,000.00-$220,000.00 4 months ago

Seattle, WA $99,500.00-$187,000.00 2 weeks ago

Software Developer-Artificial Intelligent/Machine Learning

Bellevue, WA $130,000.00-$170,000.00 5 days ago

Seattle, WA $143,000.00-$312,800.00 2 weeks ago

Machine Learning Scientist, Consumer Health Research Team

Seattle, WA $141,000.00-$202,000.00 1 week ago

AI Research Scientist - Machine Learning for Behavioral AI

Redmond, WA $147,000.00-$208,000.00 1 week ago

Seattle, WA $118,657.00-$168,150.00 2 days ago

Machine Learning Engineer, Computer Vision

Software Engineer - AI/ML, Multiple Locations

Redmond, WA $81,900.00-$174,600.00 2 weeks ago

Seattle, WA $121,000.00-$228,500.00 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.