AI Agent QA & Evaluation Analyst

Mindrift; Town of Texas (WI); Remote; USD 68,191 - 97,120; Part time

Benefits offered by this job

Flexible project schedule

Competitive pay based on expertise

Gain experience in advanced AI projects

Job summary

A forward-thinking AI company is seeking QAs for autonomous AI agents to validate and improve complex task structures. This is a flexible, remote role ideal for those with strong analytical skills, attention to detail, and an interest in AI. Responsibilities include reviewing tasks for logic, identifying inconsistencies, and defining expected behaviors for AI agents. Earn up to $60/hour based on skills and experience while contributing to innovative AI projects.

Qualifications

• Must reason about complex systems and logical implications.
• Strong attention to detail needed to spot contradictions.
• Good communication in English to document findings.

Responsibilities

• Review evaluation tasks for logic and completeness.
• Identify inconsistencies or unclear decision points.
• Define clear expected behaviors for AI agents.
• Suggest refinements or edge-case coverage.
• Collaborate with QA, writers, and developers for refinements.

Skills

Analytical thinking

Attention to detail

Good communication

Familiarity with structured data formats

Job description

A forward-thinking AI company is seeking QAs for autonomous AI agents to validate and improve complex task structures. This is a flexible, remote role ideal for those with strong analytical skills, attention to detail, and an interest in AI. Responsibilities include reviewing tasks for logic, identifying inconsistencies, and defining expected behaviors for AI agents. Earn up to $60/hour based on skills and experience while contributing to innovative AI projects.