AI Evaluation Project Intern

ByteDance; Dubai; On-site; AED 33,000 - 67,000; Part time

Job summary

Byte Dance's AI Vertical Scenarios Team in Dubai invites interns to work on real workflows for internal AI evaluations and agent integrations, tackling end-to-end benchmarking on leading models. You will contribute to short-term projects, design evaluation methods, and write queries and rubrics, gaining hands-on experience in a fast-paced, global tech environment.

This internship offers the opportunity to develop practical AI skills, apply knowledge to real-world challenges, and explore career

Qualifications

• Currently pursuing an Undergraduate in Computer Science, AI, Information Management or a related technical discipline.
• Strong hands on AI experience from non CS backgrounds is equally welcome.
• Available to start the internship immediately, ideally within one week.
• Clear logical thinking, self driven, and user value oriented, with strong communication and cross team collaboration skills.
• Genuine interest in AI products and a habit of following the latest developments in the LLM and agent space.
• Able to work on site in Dubai full time or part time (ideally 2 to 3 days per week).

Responsibilities

• Ground the work in real user needs through user interviews, literature review, and usage data analysis.
• Propose research methodology: how queries are generated, how rubrics are structured, and how models are scored.
• Write curated queries with prerequisites, across three difficulty levels: Simple, Medium, and Complex.
• Write rubrics: checklist items defining a correct answer (e.g., for a leave request: leave type, date parsing, balance check, approver routing, form completeness, submission state).
• Run models against the queries and score outputs on an ongoing cadence, reviewing multiple agents and models against the benchmark each month.
• Automate the evaluation so the loop can be re-run as models and internal systems evolve.
• Write the evaluation report covering findings, failure patterns, and recommendations.
• Identifying manual workflows across the business and prototyping AI solutions to automate them.
• Contributing to AI product work by shaping agent capabilities, and helping ship new AI features into internal workplace and knowledge tools.

Skills

AI experience

Analytical thinking

Cross-team collaboration

On-site in Dubai

Education

Undergraduate in Computer Science / AI

Tools

LLM evaluation design

Query writing for evaluations

Job description

Responsibilities

We are the AI Vertical Scenarios Team within Byte Dance's Corporate Service System, based in Dubai. Our mission is to set the standard for AI native applications across Byte Dance's internal workplace and procurement scenarios, and to drive consistent AI experiences for employees globally. We build flagship AI applications in-house and use a full scope evaluation suite as our measurement foundation to track how well leading models perform on the real, day to day tasks Byte Dance employees carry out.

Why join us

Real scenarios, real users: the evaluations you design and the AI applications you contribute to are grounded in the actual workflows of Byte Dance employees worldwide. Hands on with frontier AI: work directly with Claude, Doubao Seed 2.1, and internal agent infrastructure and agent-building tools. Broad scope: opportunities to prototype AI solutions to manual workflows, and to contribute to strategic AI projects that shape how Byte Dance employees experience corporate services globally.

As a Project Intern, you will contribute to impactful short-term projects and gain hands-on experience in a fast-paced, professional environment. This internship offers the opportunity to develop practical skills, apply your knowledge to real-world challenges, and explore your career interests.

Online Assessment

Candidates who pass resume screening will be invited to participate in Our Company's technical online assessment.

Responsibilities

Core evaluation work:

Own a Defined Scope Of Byte Dance's AI Evaluation Benchmark End To End, With Ownership To Identify Problems And Propose Solutions. You'll Run The Full Research And Evaluation Loop On Some Of The World's Most Widely Used AI Agents, Surfacing Capability Gaps And Failure Modes, And Turning Those Findings Into Actionable Insights That Directly Drive The Agent's Iteration At Global Scale.

This Includes:

• Ground the work in real user needs through user interviews, literature review, and usage data analysis.


• Propose research methodology: how queries are generated, how rubrics are structured, and how models are scored.


• Write curated queries with prerequisites, across three difficulty levels: Simple, Medium, and Complex.


• Write rubrics: checklist items defining a correct answer (e.g., for a leave request: leave type, date parsing, balance check, approver routing, form completeness, submission state).


• Run models against the queries and score outputs on an ongoing cadence, reviewing multiple agents and models against the benchmark each month.


• Automate the evaluation so the loop can be re-run as models and internal systems evolve.


• Write the evaluation report covering findings, failure patterns, and recommendations.

Additional project work:

Beyond The Core Evaluation Work, Interns Will Have Full Agency To Support And Lead Ad Hoc Projects That Shape How AI Gets Implemented And Adopted Across Byte Dance Globally, Including:

• Identifying manual workflows across the business and prototyping AI solutions to automate them.


• Contributing to AI product work by shaping agent capabilities, and helping ship new AI features into internal workplace and knowledge tools.

Qualifications

Minimum Qualifications

• Currently pursuing a Undergraduate in Computer Science, AI, Information Management or a related technical discipline.


• Strong hands on AI experience from non CS backgrounds is equally welcome.


• Available to start the internship immediately, ideally within one week.


• Clear logical thinking, self driven, and user value oriented, with strong communication and cross team collaboration skills.


• Genuine interest in AI products and a habit of following the latest developments in the LLM and agent space.


• Able to work on site in Dubai full time or part time (ideally 2 to 3 days per week).

Preferred Qualifications

• Relevant internship or project experience in AI products or AI evaluations.


• Prior experience designing or running LLM evaluations.


• Prior work translating user problems into AI applications, particularly in office automation, knowledge management, or adjacent productivity domains.

Job Information

About Us

Founded in 2012, Byte Dance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including Tik Tok, Lemon8, Cap Cut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, Byte Dance has made it easier and more fun for people to connect with, consume, and create content.

Why Join Byte Dance

Inspiring creativity is at the core of Byte Dance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As Byte Dancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an \"Always Day 1\" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

Byte Dance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At Byte Dance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.