LLM Data & Evaluation Intern

AI Rudder; Jakarta Pusat; Hybrid; IDR 66,960,000 - 100,440,000; Full time

Benefits offered by this job

Learning & Development

Performance Recognition

Global Exposure

Meaningful Impact

Ownership & Autonomy

Team Engagement

Job summary

AI Rudder is a conversational AI company based in Jakarta, offering a hybrid work arrangement. The role involves supporting evaluation workflows for LLMs across chat, voice, and task-based use cases, reviewing outputs for quality, and labeling datasets with high consistency.

Recent graduates or final-year students with a Bachelor's degree who are fluent in English and Bahasa Indonesia are encouraged to apply.

Qualifications

• Recent graduate or final-year student with a Bachelor's degree.
• Fluent in English and Bahasa Indonesia.
• Strong analytical thinking and attention to detail.
• Familiar with AI/ChatGPT/LLM tools and comfortable with spreadsheets.
• Able to follow guidelines consistently and learn fast.
• Nice to have: data labeling/QA, prompt engineering, Python/SQL, Jira/Notion, reporting skills.

Responsibilities

• Support evaluation workflows for LLMs across chat, voice, and task-based use cases.
• Review model outputs for quality, factuality, safety, and user experience.
• Label / annotate datasets with high consistency.
• Assist in prompt testing, A/B comparisons, and regression checks.
• Identify recurring failure patterns and summarize findings for seniors.
• Prepare reports, trackers, and dashboards for quality metrics and progress.
• Collaborate with Data, Product, QA, and Operations on improvement cycles.
• Help organize datasets for training, fine-tuning, and benchmarking.

Skills

Analytical thinking

Attention to detail

English proficiency

Bahasa Indonesia

Guidelines adherence

Prompt engineering (nice to have)

Python (nice to have)

SQL (nice to have)

Data labeling/QA

Communication skills

Education

Bachelor's degree

Final-year student

Tools

Jira

Notion

Spreadsheets

Job description

AI Rudder is a conversational AI company based in Jakarta, offering a hybrid work arrangement. The role involves supporting evaluation workflows for LLMs across chat, voice, and task-based use cases, reviewing outputs for quality, and labeling datasets with high consistency.

Recent graduates or final-year students with a Bachelor's degree who are fluent in English and Bahasa Indonesia are encouraged to apply.