Remote AI Agent QA & Evaluation Analyst

Mindrift; Remoto; EUR 50.000 - 70.000; Part-time

Descrizione del lavoro

A tech-focused company is searching for Quality Assurance professionals to support an AI project in validating complex task structures and policies. Candidates should possess excellent analytical thinking, attention to detail, and be capable of holistic assessment of scenarios. This flexible, remote role allows individuals to apply their expertise while working around existing commitments. Compensation is competitive, with rates up to $32/hour based on skills and experience.

Servizi

Flexible schedule

Competitive pay

Valuable AI project experience

Competenze

• Ability to reason about complex systems and scenarios.
• Can spot contradictions and vague requirements.
• Familiarity with structured data formats like JSON/YAML.
• Able to assess scenarios for missing or unrealistic elements.

Mansioni

• Review evaluation tasks for logic and completeness.
• Identify inconsistencies and unclear decision points.
• Define expected behaviors for AI agents.
• Annotate cause-effect relationships.
• Test agents and suggest refinements.

Conoscenze

Analytical thinking

Attention to detail

Good communication

Holistic assessment

Descrizione del lavoro

A tech-focused company is searching for Quality Assurance professionals to support an AI project in validating complex task structures and policies. Candidates should possess excellent analytical thinking, attention to detail, and be capable of holistic assessment of scenarios. This flexible, remote role allows individuals to apply their expertise while working around existing commitments. Compensation is competitive, with rates up to $32/hour based on skills and experience.