Senior Machine Learning Engineer, Developer AI

ByteDance; San Jose (CA); On-site; USD 218,000 - 480,000; Full time

Benefits offered by this job

Medical insurance (Day one)

Job summary

ByteDance’s Dev Infra team is hiring a Senior Machine Learning Engineer to support the Dev AI initiative. You will build intelligent systems that help software engineers at scale, including AI for code generation, automated testing, debugging, code understanding, and agentic software engineering.

You will own end-to-end ML projects, collaborating across teams to design scalable, reliable solutions and continuously improve model performance in production environments.

Qualifications

• Bachelor’s degree or above in Computer Science, AI, ML, Software Engineering, or related field.
• 5+ years of relevant industry or research experience in machine learning, LLMs, code intelligence, AI-powered developer tools, or related areas.
• Strong programming skills in Python, Go, Java, C++, JavaScript, or TypeScript.
• Solid understanding of data structures, algorithms, ML, OS, databases, and system design principles.
• Experience owning complex ML projects end-to-end from problem formulation to deployment and production iteration.
• Strong system design and engineering skills for scalable ML systems or AI-powered applications.
• Strong communication and collaboration skills across teams.

Responsibilities

• Develop and improve ML and LLM systems for software engineering tasks, including code generation and debugging.
• Build AI-powered developer agents and workflows that can reason over large codebases and support engineers across the lifecycle.
• Enhance model and agent performance with prompt engineering, context engineering, retrieval, fine-tuning, RL, and tool-use design.
• Create training and evaluation data pipelines for software engineering tasks, including data collection and labeling.
• Apply advances in ML, code intelligence, program analysis, and autonomous software engineering to improve developer productivity at scale.

Skills

Communication

Collaboration

System design

Education

Bachelor's degree or above in CS/AI/ML/SE

Tools

Python

Go

Java

C++

JavaScript

TypeScript

Job description

ByteDance’s Dev Infra team is hiring a Senior Machine Learning Engineer to support the Dev AI initiative. The focus is on building intelligent systems that help software engineering teams work at scale, including AI for code generation, automated testing, debugging, code understanding, and agentic software engineering.

What You’ll Do

• Develop and improve machine learning and large language model systems for software engineering tasks, including code generation, unit test generation, and debugging.
• Build AI-powered developer agents and intelligent workflows that can reason over large codebases, operate with development environments and tools, execute multi-step engineering tasks, and support engineers across the software development lifecycle.
• Enhance model and agent performance using prompt engineering, context engineering, retrieval, fine-tuning, reinforcement learning, tool-use design, and agent harness engineering.
• Create training and evaluation data pipelines for software engineering tasks, including data collection, filtering, synthesis, labeling, and hard-example mining.
• Apply advances in large language models, code intelligence, program analysis, reinforcement learning, and autonomous software engineering to address real developer productivity needs at scale.

Requirements

• Bachelor’s degree or above in Computer Science, Artificial Intelligence, Machine Learning, Software Engineering, or a related field.
• 5+ years of relevant industry or research experience in machine learning, large language models, code intelligence, AI-powered developer tools, or related areas.
• Strong programming skills in one or more languages such as Python, Go, Java, C++, JavaScript, or TypeScript.
• Solid understanding of data structures, algorithms, machine learning, operating systems, databases, and fundamental system design principles.
• Experience owning complex machine learning projects end-to-end, from problem formulation and data construction to model development, evaluation, deployment, and production iteration.
• Strong system design and engineering skills, including building scalable, reliable, and efficient machine learning systems or AI-powered applications.
• Strong communication and collaboration skills, including driving complex technical projects across teams.

Technologies

• Python
• Go
• Java
• C++
• JavaScript
• TypeScript

Preferred Qualifications

• Experience building or leading AI systems for software engineering, including code generation, coding agents, unit test generation, debugging, or code review.
• Deep experience with large language models and one or more model improvement or post-training techniques, such as supervised fine-tuning, reinforcement learning, preference optimization, prompt engineering, context engineering, retrieval, or model evaluation.
• Experience designing and improving agentic systems, including tool-using LLMs, coding agents, agent harnesses, MCP, agent skills, planning, memory, or multi-step execution workflows.
• Experience building large-scale training data, evaluation datasets, benchmarks, or experimentation pipelines for machine learning or code intelligence systems.
• Strong understanding of software engineering and code intelligence techniques such as program analysis, compilers, static analysis, code search, repository indexing, testing, and debugging.
• Publications, patents, open-source contributions, or demonstrated technical leadership in machine learning, large language models, code intelligence, developer tools, or AI for software engineering.

Compensation

Salary: USD 218,400 - 480,000 per year (base salary range for the selected city).

Location and Work Setup

• Location: San Jose, CA
• Onsite: Yes

Benefits

• Day one access to medical, dental, and vision insurance
• 401(k) savings plan with company match
• Paid parental leave
• Short-term and long-term disability coverage
• Life insurance
• Wellbeing benefits
• 10 paid holidays per year
• 10 paid sick days per year
• 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)
• Additional discretionary bonuses/incentives and restricted stock units (role may be eligible)

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in its recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs, or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, reach out at https://tinyurl.com/RA-request.

Equal Opportunity / Fair Chance (Los Angeles County Unincorporated)

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. ByteDance notes that criminal history may have a direct, adverse, and negative relationship on job duties, potentially resulting in the withdrawal of a conditional offer of employment, including interacting with internal or external clients or colleagues, handling confidential information, and exercising sound judgment.