Data & Evaluation LLM Intern(A18156)

AI Rudder; Jakarta Pusat; Hybrid; IDR 66,960,000 - 100,440,000; Full time

Benefits offered by this job

Learning & Development

Performance Recognition

Global Exposure

Meaningful Impact

Ownership & Autonomy

Team Engagement

Job summary

AI Rudder is a conversational AI company based in Jakarta, offering a hybrid work arrangement. The role involves supporting evaluation workflows for LLMs across chat, voice, and task-based use cases, reviewing outputs for quality, and labeling datasets with high consistency.

Recent graduates or final-year students with a Bachelor's degree who are fluent in English and Bahasa Indonesia are encouraged to apply.

Qualifications

• Recent graduate or final-year student with a Bachelor's degree.
• Fluent in English and Bahasa Indonesia.
• Strong analytical thinking and attention to detail.
• Familiar with AI/ChatGPT/LLM tools and comfortable with spreadsheets.
• Able to follow guidelines consistently and learn fast.
• Nice to have: data labeling/QA, prompt engineering, Python/SQL, Jira/Notion, reporting skills.

Responsibilities

• Support evaluation workflows for LLMs across chat, voice, and task-based use cases.
• Review model outputs for quality, factuality, safety, and user experience.
• Label / annotate datasets with high consistency.
• Assist in prompt testing, A/B comparisons, and regression checks.
• Identify recurring failure patterns and summarize findings for seniors.
• Prepare reports, trackers, and dashboards for quality metrics and progress.
• Collaborate with Data, Product, QA, and Operations on improvement cycles.
• Help organize datasets for training, fine-tuning, and benchmarking.

Skills

Analytical thinking

Attention to detail

English proficiency

Bahasa Indonesia

Guidelines adherence

Prompt engineering (nice to have)

Python (nice to have)

SQL (nice to have)

Data labeling/QA

Communication skills

Education

Bachelor's degree

Final-year student

Tools

Jira

Notion

Spreadsheets

Job description

Office Location: Sequis Tower, SCBD, Jakarta

Work Arrangement: Hybrid (WFO + WFA)

Responsibilities

• Support evaluation workflows for Large Language Models (LLMs) across chat, voice, and task-based use cases.
• Review model outputs for quality, factuality, instruction-following, safety, tone, and user experience.
• Label / annotate datasets based on internal guidelines and maintain high consistency.
• Assist in prompt testing, A/B comparisons, and regression checks after model updates.
• Identify recurring failure patterns and summarize findings to senior team members.
• Prepare reports, trackers, and dashboards for quality metrics and project progress.
• Collaborate with Data, Product, QA, and Operations teams on improvement cycles.
• Help organize datasets for training, fine-tuning, and benchmarking.

Qualifications

• Recent graduate with a Bachelor's degree, or currently a final-year student.
• Fluent in English and Bahasa Indonesia.
• Strong analytical thinking and attention to detail.
• Familiar with AI/ChatGPT/LLM tools and comfortable with spreadsheets (Excel/Google Sheets).
• Able to follow guidelines consistently, handle repetitive tasks accurately, communicate well, and learn fast.
• Nice to have skills: Data labeling/QA/content moderation, prompt engineering, Python/SQL, Jira/Notion, voice bot/call evaluation, or reporting skills.

About AI Rudder

AI Rudder is a conversational AI company on a mission to transform how businesses communicate with their customers — across voice and digital channels that feel genuinely human.

Founded in 2019 and headquartered in Singapore, we're building technologies that bridge languages, enhance understanding, and enable meaningful human–machine communication at scale.

Today, we serve 500+ enterprise clients globally processing 50 million calls daily and having delivered more than 8 billion calls to date.

Most recently, we have raised $50M in a Series B fundraising from leading global investors including Tiger Global, Peak XV Partners, and Cathay Innovation.

How We Work

AI-first: AI isn't a tool we reach for. It's the default we start from. Every team, every workflow: AI-first.

Global Collaboration: We operate globally and work as one team. Distance is a logistics problem, not a cultural one. We build the habits that make distributed teams actually work.

Communication Principle: Simple, Trust, Transparent. We remove unnecessary complexity so people can focus on what matters most.

What We Offer

• Learning & Development: Continuous learning through real projects, knowledge sharing session, mentorship, and cross-functional collaboration.
• Performance Recognition: Regular performance reviews, feedback, and opportunities for career progression.
• Global Exposure: Collaborate with international teams, global rotations, and work with global enterprise customers.
• Meaningful Impact: Build AI solutions that create real value for businesses around the world.
• Ownership & Autonomy: Freedom to take initiative and drive outcomes.
• Team Engagement: Team Building, Local & Global Gatherings & Local Events Celebration.

AI Rudder is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees and applicants.