AI Evaluation & Prompt Testing Specialist

Crossing Hurdles; Indonesia; On-site; IDR 133,920,000 - 200,880,000; Full time

Job summary

Crossing Hurdles seeks a dedicated professional to design domain-specific prompts and evaluate AI responses for accuracy and reasoning. The role focuses on identifying weaknesses and developing robust test cases to push model limits, followed by providing evidence-based feedback to drive improvements.

Candidate must hold a Master’s degree or higher, with significant professional, research, or teaching experience and exceptional written English communication skills.

Qualifications

• Hold a Master's degree or higher in a relevant domain.
• Have a minimum of professional, research, or teaching experience.
• Possess excellent written English communication skills.
• Demonstrate strong analytical skills and exceptional attention to detail.

Responsibilities

• Create complex, domain-specific prompts to test LLM capabilities.
• Evaluate AI-generated responses for factual accuracy, reasoning, and quality.
• Identify factual errors, logical inconsistencies, and model weaknesses.
• Develop challenging test cases that expose model limitations.
• Provide clear, evidence-based feedback to improve model performance.

Skills

Domain-specific prompts

Evaluate responses

Error identification

Test case development

Evidence-based feedback

Education

Master's degree or higher

Job description

Crossing Hurdles seeks a dedicated professional to design domain-specific prompts and evaluate AI responses for accuracy and reasoning. The role focuses on identifying weaknesses and developing robust test cases to push model limits, followed by providing evidence-based feedback to drive improvements.

Candidate must hold a Master’s degree or higher, with significant professional, research, or teaching experience and exceptional written English communication skills.