Remote AI Agent QA & Systems Evaluator (Part-Time)

Mindrift

Mississippi

Remote

USD 55,000 - 75,000

Part time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive pay up to $80/hr
Flexible, remote work
Participation in advanced AI projects

Job summary

A leading AI consultancy is searching for QA analysts to validate AI agents in a project focused on improving complex tasks. This opportunity is a flexible, remote, part-time role ideal for curious thinkers with strong analytical skills. You will review tasks, ensure logic and completeness, and identify inconsistencies in AI evaluation. Competitive compensation up to $80/hr is offered, making it an excellent opportunity for individuals looking to expand their experience in the evolving field of AI.

Qualifications

  • Excellent analytical thinking on complex systems and logical implications.
  • Strong attention to detail for spotting contradictions and ambiguities.
  • Familiarity with JSON/YAML structured data formats.
  • Ability to evaluate scenarios holistically for realism.

Responsibilities

  • Review evaluation tasks for logic and completeness.
  • Identify inconsistencies and unclear decision points.
  • Help define expected behaviors for AI agents.
  • Annotate cause-effect relationships and reasoning paths.
  • Work closely with QA and developers to improve coverage.

Skills

Analytical thinking
Attention to detail
Structured data formats
Good communication in English

Job description

A leading AI consultancy is searching for QA analysts to validate AI agents in a project focused on improving complex tasks. This opportunity is a flexible, remote, part-time role ideal for curious thinkers with strong analytical skills. You will review tasks, ensure logic and completeness, and identify inconsistencies in AI evaluation. Competitive compensation up to $80/hr is offered, making it an excellent opportunity for individuals looking to expand their experience in the evolving field of AI.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Agent Evaluator & Logic QA Analyst
Remote AI Agent Evaluator & Logic QA Analyst

Mindrift • Arizona

Remote
USD 82,656 - 110,208
Flexible work schedule
High hourly rates up to $80
Experience in advanced AI projects
Remote AI Agent QA Analyst - Flexible, Impactful Evaluation
Remote AI Agent QA Analyst - Flexible, Impactful Evaluation

Mindrift • Houston (TX)

Remote
USD 90,921 - 129,494
Flexible hours
Competitive pay
Remote work opportunity
+1
Remote AI Agent Evaluator QA Strategist
Remote AI Agent Evaluator QA Strategist

Mindrift • Wisconsin

Remote
USD 68,191 - 97,120
Competitive pay up to $60/hour
Flexible remote work
Opportunity to work on advanced AI projects
Remote AI Agent QA & Evaluation Analyst
Remote AI Agent QA & Evaluation Analyst

Mindrift • North Carolina

Remote
USD 75,768
Competitive pay up to $55/hour
Flexible and remote work
Valuable experience in AI projects
Remote AI Agent Evaluation Analyst
Remote AI Agent Evaluation Analyst

Mindrift • Minnesota

Remote
USD 55,104 - 110,208
Rates up to $80/hour
Flexible remote work
Valuable experience on AI projects
Remote AI Agent Evaluation Analyst
Remote AI Agent Evaluation Analyst

Mindrift • Alabama

Remote
USD 90,921 - 129,494
Flexible working hours
Competitive pay up to $80/hour
Experience in advanced AI projects
Remote AI Agent Evaluation Specialist
Remote AI Agent Evaluation Specialist

Mindrift • Missouri

Remote
USD 41,328 - 82,656
Competitive pay up to $60/hour
Flexible remote work
Valuable experience in AI projects
+1
Autonomous AI QA & Evaluation Analyst (Remote)
Autonomous AI QA & Evaluation Analyst (Remote)

Mindrift • New York (NY)

Remote
USD 90,921 - 129,494
Flexible, remote freelance project
Opportunity to enhance your portfolio
Competitive pay rates
Remote AI Agent QA & Evaluation Specialist
Remote AI Agent QA & Evaluation Specialist

Mindrift • Dallas (TX)

Remote
USD 55,104 - 75,768
Flexible remote work
Competitive pay up to $55/hour
Experience in advanced AI projects
Autonomous AI QA & Evaluation Analyst (Remote)
Autonomous AI QA & Evaluation Analyst (Remote)

Mindrift • Arizona

Remote
USD 90,921 - 129,494
Flexible remote work
Competitive pay up to $80/hour
Experience in advanced AI projects