Remote AI Agent Evaluation Specialist

Mindrift; Missouri; Remote; USD 41,328 - 82,656; Part time

Benefits offered by this job

Competitive pay up to $60/hour

Flexible remote work

Valuable experience in AI projects

Opportunity to influence AI model understanding

Job summary

An innovative tech company in Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical thinking skills, alongside attention to detail and familiarity with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected AI behaviors. The role offers competitive pay up to $60/hour and is ideal for those in academia or consulting with an interest in AI.

Qualifications

• Excellent analytical thinking regarding complex systems and logical implications.
• Strong attention to detail to spot contradictions and ambiguities.
• Familiarity with JSON/YAML data formats.

Responsibilities

• Review evaluation tasks for logic completeness and realism.
• Identify inconsistencies and missing assumptions.
• Define clear expected behaviors for AI agents.
• Annotate cause-effect relationships and reasoning paths.
• Ensure proper testing of AI agents.
• Work closely with QA, writers, or developers for refinements.

Skills

Analytical thinking

Attention to detail

Structured data formats

Holistic assessment

Communication

Job description

An innovative tech company in Missouri is seeking contributors for a part-time QA project focused on autonomous AI agents. This flexible remote opportunity requires strong analytical and critical thinking skills, alongside attention to detail and familiarity with structured data formats. Candidates will review evaluation tasks, identify inconsistencies, and help define expected AI behaviors. The role offers competitive pay up to $60/hour and is ideal for those in academia or consulting with an interest in AI.