Remote AI Agent Evaluator & Trainer (QA)

Mindrift; Remote; GBP 60,000 - 80,000; Part time

Job summary

A future-focused AI consultancy is looking for QA contributors to validate and improve AI agents' evaluation frameworks. Ideal candidates will possess strong analytical skills and attention to detail while enjoying a flexible, remote work environment. Responsibilities include reviewing evaluation tasks, defining expected behaviors for agents, and collaborating with cross-functional teams to enhance AI systems. This role provides an opportunity to influence future AI technologies and build a unique portfolio.

Qualifications

• Ability to reason about complex systems and scenarios.
• Skilled in identifying inconsistencies and vague requirements.
• Experience with AI, policy evaluation, or logic puzzles.

Responsibilities

• Review evaluation tasks for logic and completeness.
• Help define expected behaviors for AI agents.
• Work closely with teams to suggest refinements.

Skills

Analytical thinking

Attention to detail

Communication skills

Familiarity with structured data formats

Understanding of QA processes

Job description

A future-focused AI consultancy is looking for QA contributors to validate and improve AI agents' evaluation frameworks. Ideal candidates will possess strong analytical skills and attention to detail while enjoying a flexible, remote work environment. Responsibilities include reviewing evaluation tasks, defining expected behaviors for agents, and collaborating with cross-functional teams to enhance AI systems. This role provides an opportunity to influence future AI technologies and build a unique portfolio.