Remote AI Agent QA Analyst - Flexible, Impactful Evaluation

Mindrift; Houston (TX); Remote; USD 90,921 - 129,494; Part time

Benefits offered by this job

Flexible hours

Competitive pay

Remote work opportunity

Experience in advanced AI projects

Job summary

A tech company specializing in AI is seeking QAs for autonomous AI agents to validate and enhance task structures. This flexible, project-based opportunity allows contributors to work remotely while engaging in a complex AI project. Ideal candidates will possess strong analytical skills and attention to detail, facilitating AI testing and evaluation without needing a coding background. The role offers competitive pay up to $80/hour based on experience and skills, enriching your portfolio while influencing the future of AI.

Qualifications

• Excellent analytical thinking about complex systems and scenarios.
• Strong attention to detail to identify contradictions and ambiguities.
• Familiarity with structured data formats like JSON/YAML.
• Ability to assess complex scenarios holistically.
• Good communication skills to document findings in English.

Responsibilities

• Review evaluation tasks for logic, completeness, and realism.
• Identify inconsistencies and missing assumptions.
• Define expected behaviors for AI agents.
• Annotate reasoning paths and plausible alternatives.
• Test agents by thinking through complex systems.

Skills

Analytical thinking

Attention to detail

Structured data formats

Good communication

Job description

A tech company specializing in AI is seeking QAs for autonomous AI agents to validate and enhance task structures. This flexible, project-based opportunity allows contributors to work remotely while engaging in a complex AI project. Ideal candidates will possess strong analytical skills and attention to detail, facilitating AI testing and evaluation without needing a coding background. The role offers competitive pay up to $80/hour based on experience and skills, enriching your portfolio while influencing the future of AI.