AI Analyst | $36/hr Remote

Crossing Hurdles; India; On-site; INR 600,000 - 1,200,000; Full time

Job summary

Crossing Hurdles is seeking an evaluator to assess AI models and agents across predefined scenarios, perform operational tests, and document observations. The role requires meticulous attention to detail, the ability to follow complex instructions, and capacity to handle repetitive evaluation tasks within project protocols.

The candidate will reset usage limits as needed, repeat evaluations, and submit comprehensive datasets on AI training platforms, contributing to ongoing AI research and

Qualifications

• Experience with AI products, AI models, or AI agent evaluation and testing.
• Demonstrated ability to follow complex instructions with precision and consistency.
• Exceptional attention to detail and operational thoroughness.

Responsibilities

• Evaluate AI models and agents according to detailed, pre-defined scenarios and guidelines.
• Execute operational tasks to test model accuracy, reasoning, and responsiveness.
• Document findings, observations, and anomalies in structured written reports.
• Reset usage limits and repeat evaluations as required by project protocols.
• Record findings and submit evaluation datasets on AI training platforms.

Skills

AI product experience

following complex instructions

attention to detail

operational thoroughness

Job description

• Evaluate AI models and agents according to detailed, pre-defined scenarios and guidelines.
• Execute operational tasks to test model accuracy, reasoning, and responsiveness.
• Document findings, observations, and anomalies in structured written reports.
• Reset usage limits and repeat evaluations as required by project protocols.
• Record findings and submit evaluation datasets on AI training platforms.

Requirements

• Experience with AI products, AI models, or AI agent evaluation and testing.
• Demonstrated ability to follow complex instructions with precision and consistency.
• Exceptional attention to detail and operational thoroughness.
• Comfort working with repetitive or high-volume operational tasks.
• Prior participation in digital product, software QA, or AI research projects is a plus.