Remote AI Agent Evaluation Specialist

Mindrift; Rhode Island; Remote; USD 90,921 - 129,494; Part time

Benefits offered by this job

Flexible work hours

Competitive pay

Participation in advanced AI projects

Job summary

A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates will work on complex systems, ensuring quality assurance and logical problem-solving. Ideal candidates are analytical thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers competitive pay up to $80/hour, allowing integration with academic or professional commitments.

Qualifications

• Excellent analytical thinking: reason about complex systems, scenarios, and logical implications.
• Strong attention to detail: spot contradictions, ambiguities, and vague requirements.
• Good communication and clear writing (in English) to document findings.

Responsibilities

• Review evaluation tasks and scenarios for logic, completeness, and realism.
• Identify inconsistencies, missing assumptions, or unclear decision points.
• Define clear expected behaviors for AI agents.

Skills

Analytical thinking

Attention to detail

Good communication skills

Job description

A technology firm is seeking QAs for autonomous AI agents to validate and improve task structures within a new project. Candidates will work on complex systems, ensuring quality assurance and logical problem-solving. Ideal candidates are analytical thinkers with strong attention to detail and experience in evaluating scenarios. This flexible, project-based role offers competitive pay up to $80/hour, allowing integration with academic or professional commitments.