Remote AI Agent Evaluation Analyst

Mindrift

United Kingdom

Remote

GBP 25,628 - 51,257

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible, remote working schedule
Competitive pay up to $50 per hour
Experience in an advanced AI project

Job summary

A cutting-edge technology company is seeking QAs for an innovative project focused on autonomous AI agents. This role involves reviewing tasks for quality, identifying inconsistencies, and defining expected behaviors for agents. Ideal candidates should possess strong analytical thinking, attention to detail, and good communication skills. The position is part-time, remote, and offers competitive rates up to $50 per hour based on experience. Join a team that's shaping the future of AI!

Qualifications

  • Excellent reasoning about complex systems and logical implications.
  • Ability to spot contradictions and vague requirements.
  • Good communication skills for documenting findings.

Responsibilities

  • Review evaluation tasks for logic, completeness, and realism.
  • Identify inconsistencies and unclear decision points.
  • Define expected behaviors for AI agents.
  • Annotate cause-effect relationships and reasoning paths.

Skills

Analytical thinking
Attention to detail
Communication

Tools

JSON
YAML

Job description

A cutting-edge technology company is seeking QAs for an innovative project focused on autonomous AI agents. This role involves reviewing tasks for quality, identifying inconsistencies, and defining expected behaviors for agents. Ideal candidates should possess strong analytical thinking, attention to detail, and good communication skills. The position is part-time, remote, and offers competitive rates up to $50 per hour based on experience. Join a team that's shaping the future of AI!
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Agent Evaluation Engineer - Part-Time, Project-Based
AI Agent Evaluation Engineer - Part-Time, Project-Based

Mindrift • Birmingham

Remote
GBP 42,030 - 59,862
AI Agent QA Tester - Remote-First, 6M Contract
AI Agent QA Tester - Remote-First, 6M Contract

Anson McCade Pty • Greater London

Hybrid
GBP 40,000 - 60,000
Remote-first model with minimal travel
Potential for contract extension
Exposure to AI transformation work
Remote AI Evaluation Specialist (Freelance)
Remote AI Evaluation Specialist (Freelance)

RWS Group • Newcastle upon Tyne

Remote
GBP 14,891 - 21,209
Timely payments
Access to additional project opportunities
Flexible engagement
Remote AI Content Quality Analyst - Entry Level
Remote AI Content Quality Analyst - Entry Level

Prime Jobs • United Kingdom

Remote
GBP 50,198 - 83,664
Remote AI Software Engineer — Project-Based & Flexible
Remote AI Software Engineer — Project-Based & Flexible

AfterQuery Experts • Greater London

Remote
GBP 52,000 - 104,000
Fully remote
Asynchronous work
Ongoing project matches
Remote AI Verification Specialist — CS Research
Remote AI Verification Specialist — CS Research

Prolific • Birmingham

Remote
GBP 37,174 - 59,479
Remote AI Data Annotator & Quality Evaluator (Contractor)
Remote AI Data Annotator & Quality Evaluator (Contractor)

Cross Border Talents • West of England

Remote
GBP 51,000 - 92,000
Remote AI Software Engineer — Model Training & Eval
Remote AI Software Engineer — Model Training & Eval

AfterQuery Experts • Cambridge

Remote
GBP 52,000 - 104,000
Competitive pay
One assessment
Fully remote
AI Agent Deployment Specialist (Remote UK)
AI Agent Deployment Specialist (Remote UK)

OpenDialog AI • Harrow

Remote
GBP 30,000 - 40,000
24 days paid holiday
Paid time off for volunteering
Wellness budget
+3
Remote AI Support & QA Specialist
Remote AI Support & QA Specialist

Prolific • Greater London

Remote
GBP 25,218 - 35,917