ML Engineer for LLMs & AI Code Gen

ByteDance; San Jose (CA); On-site; USD 162,000 - 388,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with company match

Paid parental leave

Disability coverage (short/long term)

Life insurance

Wellbeing benefits

Holidays and PTO

Job summary

ByteDance is seeking a Machine Learning Engineer for its TRAE team to design, train, and deploy large language models that power intelligent coding assistants. The role emphasizes building scalable pipelines, optimizing latency and throughput, and collaborating with infrastructure groups to run models on GPU clusters.

You will work with leading researchers to advance LLM training and deployment for AI-driven software development, contributing to state-of-the-art techniques while ensuring

Qualifications

• Bachelor’s degree or above in Computer Science, Electrical Engineering, Mathematics, or a related field.
• Solid foundation in machine learning, deep learning, and optimization algorithms.
• Proficiency in PyTorch or TensorFlow, with programming skills in Python and C++/CUDA.
• Experience with large-scale distributed training, mixed-precision training, or model parallelism.
• Hands-on experience with model quantization, pruning, or CUDA-based deployment optimization.
• Passionate about building efficient, production-ready AI systems and advancing the future of AI-driven software development.

Responsibilities

• Design, train, and fine-tune large language models (LLMs) that support TRAE’s core reasoning and code generation capabilities.
• Build efficient, stable, and scalable model training and evaluation pipelines.
• Collaborate with infrastructure and product teams to deploy and monitor models efficiently on GPU clusters.
• Continuously optimize models for latency, throughput, and accuracy.
• Stay up to date with and apply cutting-edge techniques in large model optimization and inference acceleration.

Skills

LLM training

PyTorch/TensorFlow

Python

C++/CUDA

Distributed training

Model quantization

Education

Bachelor’s degree or above in CS/EE/Math

PhD in AI related fields (preferred)

Tools

CUDA

GPU deployment tools

Job description

ByteDance is seeking a Machine Learning Engineer for its TRAE team to design, train, and deploy large language models that power intelligent coding assistants. The role emphasizes building scalable pipelines, optimizing latency and throughput, and collaborating with infrastructure groups to run models on GPU clusters.

You will work with leading researchers to advance LLM training and deployment for AI-driven software development, contributing to state-of-the-art techniques while ensuring