Remote AI Product Evaluator: Training & QA Specialist

Zekai; United States; Remote; USD 34,000 - 69,000; Full time

Job summary

Zekai is seeking an AI Product Evaluator for a 100% remote contractor role across global teams. You will apply expertise to train next-generation AI systems by evaluating models and agents against predefined scenarios.

You will document findings, reset usage limits, and contribute to datasets on training platforms, ensuring high accuracy, repeatability, and strict adherence to project milestones.

Qualifications

• Experience evaluating AI products or AI models.
• Ability to follow complex instructions with precision.
• Strong documentation and reporting skills.
• Daily use of AI tools is noted as a plus.

Responsibilities

• Evaluate AI models and agents per predefined scenarios.
• Perform repeated evaluations within project timeframes.
• Document observations and anomalies in structured reports.
• Reset usage limits and resume evaluations per protocol.
• Submit evaluation datasets to training platforms per milestones.
• Maintain high attention to detail across tasks.

Skills

AI product evaluation

QA testing

Documentation

Instruction following

Attention to detail

Job description

Zekai is seeking an AI Product Evaluator for a 100% remote contractor role across global teams. You will apply expertise to train next-generation AI systems by evaluating models and agents against predefined scenarios.

You will document findings, reset usage limits, and contribute to datasets on training platforms, ensuring high accuracy, repeatability, and strict adherence to project milestones.