AI Analyst | $36/hr Remote

Crossing Hurdles; Ciudad de México; Remote; MXN 335,000 - 580,000; Full time

Job summary

Crossing Hurdles seeks an AI evaluation specialist to assess models and agents against defined scenarios, perform operational tasks, and document results for structured datasets.

The role demands meticulous attention to detail and the ability to follow complex instructions precisely, with comfort in repetitive, high-volume work. Prior QA or AI research experience is a plus.

Qualifications

• Experience with AI products, AI models, or AI agent evaluation and testing.
• Ability to follow complex instructions with precision and consistency.
• Exceptional attention to detail and operational thoroughness.
• Comfort working with repetitive or high-volume operational tasks.
• Prior participation in digital product, software QA, or AI research projects is a plus.

Responsibilities

• Evaluate AI models and agents according to predefined scenarios and guidelines.
• Execute operational tasks to test model accuracy, reasoning, and responsiveness.
• Document findings, observations, and anomalies in structured written reports.
• Reset usage limits and repeat evaluations as required by project protocols.
• Record findings and submit evaluation datasets on AI training platforms.

Skills

AI product experience

Follow complex instructions

Attention to detail

Repetitive/high-volume tasks

QA/AI research exposure

Job description

• Evaluate AI models and agents according to detailed, pre-defined scenarios and guidelines.
• Execute operational tasks to test model accuracy, reasoning, and responsiveness.
• Document findings, observations, and anomalies in structured written reports.
• Reset usage limits and repeat evaluations as required by project protocols.
• Record findings and submit evaluation datasets on AI training platforms.

Requirements

• Experience with AI products, AI models, or AI agent evaluation and testing.
• Demonstrated ability to follow complex instructions with precision and consistency.
• Exceptional attention to detail and operational thoroughness.
• Comfort working with repetitive or high-volume operational tasks.
• Prior participation in digital product, software QA, or AI research projects is a plus.