Remote QA Analyst for Autonomous AI Agent Evaluation

Mindrift; Austin (TX); Remote; USD 68,191 - 97,120; Part time

Benefits offered by this job

Competitive pay

Flexible schedule

Experience in advanced AI projects

Job summary

A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors for agents. Ideal applicants have experience in policy evaluation or logic puzzles and good communication skills to document findings. Competitive pay of up to $60/hour based on experience and project needs. A great opportunity to influence future AI models!

Qualifications

• Ability to reason about complex systems and logical implications.
• Spot contradictions, ambiguities, and vague requirements.
• Experience in policy evaluation or logic puzzles.

Responsibilities

• Review evaluation tasks for logic and realism.
• Identify inconsistencies and unclear decision points.
• Define expected behaviours for AI agents.

Skills

Analytical thinking

Attention to detail

Good communication skills

Job description

A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote, freelance role requires strong analytical skills and attention to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors for agents. Ideal applicants have experience in policy evaluation or logic puzzles and good communication skills to document findings. Competitive pay of up to $60/hour based on experience and project needs. A great opportunity to influence future AI models!