AI Analyst | $36/hr Remote

Crossing Hurdles; Indonesia; On-site; IDR 120,000,000 - 180,000,000; Full time

Job summary

Crossing Hurdles is seeking a detail-oriented evaluator to assess AI models and agents. You will follow structured scenarios, perform repeated tests, and document results rigorously. The role emphasizes precision, consistency, and efficient handling of high-volume evaluation tasks.

Responsibilities include documenting observations, resetting usage limits as required, and submitting evaluation datasets on AI training platforms. Prior experience in digital product QA or AI research is a plus.

Qualifications

• Experience with AI products, AI models, or AI agent evaluation and testing.
• Ability to follow complex instructions with precision and consistency.
• Exceptional attention to detail and operational thoroughness.

Responsibilities

• Evaluate AI models and agents according to defined scenarios and guidelines.
• Execute operational tasks to test model accuracy, reasoning, and responsiveness.
• Document findings, observations, and anomalies in structured reports.
• Reset usage limits and repeat evaluations per project protocols.
• Record findings and submit evaluation datasets on AI training platforms.

Skills

AI testing

Documentation

Attention to detail

Repetitive tasks

English proficiency

Job description

• Evaluate AI models and agents according to detailed, pre-defined scenarios and guidelines.
• Execute operational tasks to test model accuracy, reasoning, and responsiveness.
• Document findings, observations, and anomalies in structured written reports.
• Reset usage limits and repeat evaluations as required by project protocols.
• Record findings and submit evaluation datasets on AI training platforms.

Requirements

• Experience with AI products, AI models, or AI agent evaluation and testing.
• Demonstrated ability to follow complex instructions with precision and consistency.
• Exceptional attention to detail and operational thoroughness.
• Comfort working with repetitive or high-volume operational tasks.
• Prior participation in digital product, software QA, or AI research projects is a plus.