AI Agent Evaluation Specialist — Remote & Flexible

Mindrift; North Carolina; Remote; USD 55,104 - 82,656; Part time

Benefits offered by this job

Flexible project-based work

Competitive pay

Job summary

A tech innovation company is seeking QAs for autonomous AI agents to validate and improve task structures and evaluate logic. The role requires excellent analytical thinking, attention to detail, and the ability to assess complex scenarios. Successful candidates can work flexibly and remotely, earning rates up to $60/hour. This position is ideal for analysts or students looking to contribute meaningfully to advanced AI projects while gaining valuable experience.

Qualifications

• Must evaluate complex systems and logic.
• Experience with structured data formats (JSON/YAML) preferred.
• Ability to document findings clearly.

Responsibilities

• Review evaluation tasks for logic and completeness.
• Identify inconsistencies in decision points.
• Assist in defining expected behaviors for AI agents.
• Annotate relationships and reasoning paths.
• Collaborate with QA and developers on refinements.

Skills

Analytical thinking

Attention to detail

Communication skills in English

Job description

A tech innovation company is seeking QAs for autonomous AI agents to validate and improve task structures and evaluate logic. The role requires excellent analytical thinking, attention to detail, and the ability to assess complex scenarios. Successful candidates can work flexibly and remotely, earning rates up to $60/hour. This position is ideal for analysts or students looking to contribute meaningfully to advanced AI projects while gaining valuable experience.