AI Model & Agent Quality Evaluator (Remote, Part-Time)

OpenTrain AI, Inc.; United Kingdom; Remote; GBP 14,000 - 37,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a remote, part-time contractor to test AI models and agents against defined scenarios and guidelines. You will perform repeatable evaluations, document findings in structured reports, and reset usage limits as required by the project process.

You should have experience with AI products, models, or AI agent testing, and able to follow complex instructions precisely with strong attention to detail in a high-volume setting.

Qualifications

• Experience with AI products, AI models, or AI agent evaluation and testing.
• Must follow complex instructions precisely and consistently.
• Maintain strong attention to detail during repetitive tasks.
• Comfortable working within tight project timelines.

Responsibilities

• Evaluate model and agent accuracy, reasoning, responsiveness, and instruction-following.
• Run repeatable tasks using detailed scenarios and project standards.
• Document findings and observations in structured written reports.
• Record findings and submit evaluation datasets through AI training platforms.

Skills

AI products experience

AI models

AI agent evaluation

Testing precision

Job description

OpenTrain AI, Inc. is seeking a remote, part-time contractor to test AI models and agents against defined scenarios and guidelines. You will perform repeatable evaluations, document findings in structured reports, and reset usage limits as required by the project process.

You should have experience with AI products, models, or AI agent testing, and able to follow complex instructions precisely with strong attention to detail in a high-volume setting.