LLM Systems Intern: Build & Improve AI Agents

Pangle

San Jose, Northern (CA, KY)

Hybrid

USD 27,552,000 - 41,328,000

Part time

14 days+
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

ByteDance in San Jose, California, invites interns to join the Applied Machine Learning Ark team. You will help design and operate MaaS platforms, work on end-to-end LLM systems, and analyze large-scale logs for insights and improvements.

The internship offers hands-on experience, industry exposure, and opportunities to apply knowledge to real-world challenges while building a foundation for growth. Apply early and include availability dates.

Qualifications

  • Currently pursuing a Bachelor's/ Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
  • Solid foundation in machine learning and deep learning.
  • Hands-on experience with LLM-based systems (e.g., agents, tool calling, retrieval, multi-agent systems) through research, internships, or projects.
  • Strong Python skills and experience with a mainstream ML or agent evaluation framework.
  • Demonstrated research or engineering ability through publications, substantial projects, internships, or open-source work.

Responsibilities

  • Design evaluation systems for LLM-based agents, covering task success, tool use, reasoning quality, and reliability.
  • Build benchmarks and automated judging pipelines, combining rule-based checks, model-based judging, and human review.
  • Analyze agent execution traces and user feedback to identify failure patterns and turn them into concrete system improvements.
  • Support the closed loop from experience to capability, and work with research, platform, and product teams to bring methods into production.

Skills

LLM- based systems
Python programming
Research ability
Engineering implementation

Education

Bachelor's or Master's in CS/AI/ML/Data Science

Job description

ByteDance in San Jose, California, invites interns to join the Applied Machine Learning Ark team. You will help design and operate MaaS platforms, work on end-to-end LLM systems, and analyze large-scale logs for insights and improvements.

The internship offers hands-on experience, industry exposure, and opportunities to apply knowledge to real-world challenges while building a foundation for growth. Apply early and include availability dates.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

ML & AI Agent Intern: Build Multimodal LLM Platforms
ML & AI Agent Intern: Build Multimodal LLM Platforms

Pangle • San Jose (CA), Northern (KY)

Hybrid
USD 18,000 - 36,000
LLM Agent Evaluation Engineer Intern (MaaS)
LLM Agent Evaluation Engineer Intern (MaaS)

ByteDance • Seattle (WA)

On-site
USD 58,000 - 61,000
Health insurance
10 paid holidays per year
Housing allowance
ML & AI Systems Intern — LLM & Multimodal R&D
ML & AI Systems Intern — LLM & Multimodal R&D

ByteDance • San Jose (CA)

On-site
USD 51,000 - 73,000
Health insurance
Wellbeing benefits
Housing allowance
LLM MaaS Engineer – Agents & Evaluation
LLM MaaS Engineer – Agents & Evaluation

ByteDance • San Jose (CA)

On-site
USD 128,000 - 256,000
ML Engineer Intern – Multimodal AI & LLM Systems
ML Engineer Intern – Multimodal AI & LLM Systems

ByteDance • Seattle (WA)

On-site
USD 20,000 - 27,000
LLM Systems Engineer: AI Agents & Evaluation
LLM Systems Engineer: AI Agents & Evaluation

ByteDance • Seattle (WA)

On-site
USD 120,000 - 180,000
ML Engineer, LLM & Multimodal Systems
ML Engineer, LLM & Multimodal Systems

Bytedance • San Jose (CA), Northern (KY)

Hybrid
USD 120,000 - 170,000
Graduate Data Lake & LLM Analytics Engineer
Graduate Data Lake & LLM Analytics Engineer

ByteDance • San Jose (CA)

On-site
USD 162,000 - 317,000
Medical, dental, and vision insurance
401(k) with company match
Paid parental leave
+6
Data Lake & Analytics Engineer Intern
Data Lake & Analytics Engineer Intern

ByteDance • Seattle (WA)

On-site
USD 28,000 - 41,000
LLM Agent Evaluation Engineer — Build Intelligent Agents
LLM Agent Evaluation Engineer — Build Intelligent Agents

Bytedance • San Jose (CA)

On-site
USD 154,000 - 256,000