Remote AI Agent Evaluation Specialist

Mindrift; North Carolina; Remote; USD 55,104 - 110,208; Part time

Benefits offered by this job

Flexible, remote working arrangements

Competitive pay rates up to $80/hour

Experience in advanced AI projects

Job summary

A leading tech company is seeking contributors for a flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and ensure clear expected behaviors for AI. Ideal candidates possess excellent analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/hour based on expertise and project needs. This role offers valuable experience in an advanced AI project and fits around your primary commitments.

Qualifications

• Can reason about complex systems, scenarios, and logical implications.
• Can spot contradictions, ambiguities, and vague requirements.
• Can read, not necessarily write, structured data formats like JSON/YAML.

Responsibilities

• Reviewing evaluation tasks and scenarios for logic, completeness, and realism.
• Identifying inconsistencies, missing assumptions, or unclear decision points.
• Helping define clear expected behaviours for AI agents.

Skills

Excellent analytical thinking

Strong attention to detail

Good communication and clear writing

Job description

A leading tech company is seeking contributors for a flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review tasks for logic, and ensure clear expected behaviors for AI. Ideal candidates possess excellent analytical and detail-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach up to $80/hour based on expertise and project needs. This role offers valuable experience in an advanced AI project and fits around your primary commitments.