Research Scientist – Scalable LLM Training & RL

ByteDance; San Jose (CA); On-site; USD 212,800 - 450,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) savings plan with company match

Paid parental leave

Short-term and long-term disability coverage

Life insurance

Wellbeing benefits

Paid holidays and sick days

Job summary

ByteDance is seeking talented graduate students for a role focusing on LLM training and inference. Successful candidates will develop high-performance, scalable ML systems while collaborating closely with model researchers.

Applicants need to be pursuing a Ph.D. in a related field and have a strong background in algorithms, Python, and deep learning frameworks. This position offers competitive salary and great benefits.

Qualifications

• Currently pursuing a Ph.D. in computer science, automation, or a related technical discipline.
• Familiar with algorithms, data structures and proficient in Python.
• Knowledge of deep learning algorithms and frameworks.

Responsibilities

• Develop and optimize LLM training & inference and reinforcement learning frameworks.
• Work closely with model researchers for scalable LLM training.
• Optimize GPU and CUDA performance for high-performance systems.

Skills

Algorithms and data structures

Python

Deep learning principles

GPU high-performance computing

Education

Ph.D. in computer science or related field

Tools

PyTorch

CUDA

FSDP

Megatron-LM

Job description

ByteDance is seeking talented graduate students for a role focusing on LLM training and inference. Successful candidates will develop high-performance, scalable ML systems while collaborating closely with model researchers.

Applicants need to be pursuing a Ph.D. in a related field and have a strong background in algorithms, Python, and deep learning frameworks. This position offers competitive salary and great benefits.