AI Evaluation Intern: Real-World Impact in Dubai

ByteDance; Dubai; On-site; AED 33,000 - 67,000; Part time

Job summary

Byte Dance's AI Vertical Scenarios Team in Dubai invites interns to work on real workflows for internal AI evaluations and agent integrations, tackling end-to-end benchmarking on leading models. You will contribute to short-term projects, design evaluation methods, and write queries and rubrics, gaining hands-on experience in a fast-paced, global tech environment.

This internship offers the opportunity to develop practical AI skills, apply knowledge to real-world challenges, and explore career

Qualifications

• Currently pursuing an Undergraduate in Computer Science, AI, Information Management or a related technical discipline.
• Strong hands on AI experience from non CS backgrounds is equally welcome.
• Available to start the internship immediately, ideally within one week.
• Clear logical thinking, self driven, and user value oriented, with strong communication and cross team collaboration skills.
• Genuine interest in AI products and a habit of following the latest developments in the LLM and agent space.
• Able to work on site in Dubai full time or part time (ideally 2 to 3 days per week).

Responsibilities

• Ground the work in real user needs through user interviews, literature review, and usage data analysis.
• Propose research methodology: how queries are generated, how rubrics are structured, and how models are scored.
• Write curated queries with prerequisites, across three difficulty levels: Simple, Medium, and Complex.
• Write rubrics: checklist items defining a correct answer (e.g., for a leave request: leave type, date parsing, balance check, approver routing, form completeness, submission state).
• Run models against the queries and score outputs on an ongoing cadence, reviewing multiple agents and models against the benchmark each month.
• Automate the evaluation so the loop can be re-run as models and internal systems evolve.
• Write the evaluation report covering findings, failure patterns, and recommendations.
• Identifying manual workflows across the business and prototyping AI solutions to automate them.
• Contributing to AI product work by shaping agent capabilities, and helping ship new AI features into internal workplace and knowledge tools.

Skills

AI experience

Analytical thinking

Cross-team collaboration

On-site in Dubai

Education

Undergraduate in Computer Science / AI

Tools

LLM evaluation design

Query writing for evaluations

Job description

Byte Dance's AI Vertical Scenarios Team in Dubai invites interns to work on real workflows for internal AI evaluations and agent integrations, tackling end-to-end benchmarking on leading models. You will contribute to short-term projects, design evaluation methods, and write queries and rubrics, gaining hands-on experience in a fast-paced, global tech environment.

This internship offers the opportunity to develop practical AI skills, apply knowledge to real-world challenges, and explore career