Remote AI Agent QA & Evaluation Analyst

Mindrift; North Carolina; Remote; USD 75,768; Part time

Benefits offered by this job

Competitive pay up to $55/hour

Flexible and remote work

Valuable experience in AI projects

Job summary

A leading AI innovation firm is seeking QAs for autonomous AI agents to improve evaluation frameworks. Candidates should possess excellent analytical thinking and attention to detail to review tasks and define clear standards. This remote, flexible opportunity offers rates up to $55/hour based on expertise. Ideal for individuals with strong critical thinking skills, including students or professionals looking for part-time engagements.

Qualifications

• Strong analytical thinking skills with the ability to reason about complex systems.
• High attention to detail for identifying inconsistencies in tasks.
• Good communication skills to document analysis findings clearly.

Responsibilities

• Review evaluation tasks for logic and completeness.
• Identify missing assumptions or unclear decision points.
• Define gold standards for AI agents.
• Annotate cause-effect relationships for evaluation.

Skills

Analytical thinking

Attention to detail

Communication in English

Familiarity with structured data formats

Holistic assessment

Education

Relevant academic background or experience

Job description

A leading AI innovation firm is seeking QAs for autonomous AI agents to improve evaluation frameworks. Candidates should possess excellent analytical thinking and attention to detail to review tasks and define clear standards. This remote, flexible opportunity offers rates up to $55/hour based on expertise. Ideal for individuals with strong critical thinking skills, including students or professionals looking for part-time engagements.