Remote AI Agent QA & Evaluation Specialist

Mindrift; Dallas (TX); Remote; USD 55,104 - 75,768; Part time

Benefits offered by this job

Flexible remote work

Competitive pay up to $55/hour

Experience in advanced AI projects

Job summary

A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure the quality of complex systems and scenarios. This flexible, remote project is ideal for those with excellent analytical skills and attention to detail. Candidates should be adept at evaluating scenarios and documenting findings. The role offers competitive pay up to $55/hour based on expertise and experience.

Qualifications

• Can reason about complex systems, scenarios, and logical implications.
• Can spot contradictions, ambiguities, and vague requirements.
• Can read JSON/YAML, familiarity with structured data formats.

Responsibilities

• Review evaluation tasks and scenarios for logic, completeness, and realism.
• Identify inconsistencies, missing assumptions, or unclear decision points.
• Help define clear expected behaviors for AI agents.

Skills

Excellent analytical thinking

Strong attention to detail

Good communication and clear writing

Job description

A leading AI innovation firm in Dallas is seeking QAs for autonomous AI agents to ensure the quality of complex systems and scenarios. This flexible, remote project is ideal for those with excellent analytical skills and attention to detail. Candidates should be adept at evaluating scenarios and documenting findings. The role offers competitive pay up to $55/hour based on expertise and experience.