Autonomous AI QA & Evaluation Analyst (Remote)

Mindrift; New York (NY); Remote; USD 90,921 - 129,494; Part time

Benefits offered by this job

Flexible, remote freelance project

Opportunity to enhance your portfolio

Competitive pay rates

Job summary

A forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent analytical skills and attention to detail. Applicants will review scenarios, identify inconsistencies, and help define expected behaviors for AI agents. Offering up to $80/hour, this position allows for flexible, remote work while contributing to advanced AI projects that positively influence future technology.

Qualifications

• Can reason about complex systems and scenarios.
• Can spot contradictions and vague requirements.
• Can read structured data formats like JSON/YAML.

Responsibilities

• Review evaluation tasks for logic and completeness.
• Identify inconsistencies in decision points.
• Help define expected behaviors for AI agents.

Skills

Excellent analytical thinking

Strong attention to detail

Good communication and clear writing in English

Education

Experience with policy evaluation or structured scenario design

Background in consulting or academia

Job description

A forward-thinking tech company is seeking QAs for autonomous AI agents to validate complex task structures and improve evaluation frameworks. The role requires excellent analytical skills and attention to detail. Applicants will review scenarios, identify inconsistencies, and help define expected behaviors for AI agents. Offering up to $80/hour, this position allows for flexible, remote work while contributing to advanced AI projects that positively influence future technology.