AI Training & Evaluation Lead (Remote)

YO IT Consulting; Manchester; On-site; GBP 34,440 - 68,880; Full time

Job summary

YO IT Consulting is seeking an AI Trainer Lead for a remote contract role. You will guide data annotation and evaluation to shape how models learn, reason, and perform across domains. Your expertise will influence rubrics, scoring, and feedback loops with client teams.

The ideal candidate has strong attention to detail, excellent communication, and hands-on experience in AI training or data annotation, with the ability to work independently in a fully remote environment.

Qualifications

• Bachelor’s degree required.
• Experience in AI training or data annotation is valued.
• Remote work capability and collaboration.
• Attention to detail in data annotation and content evaluation.
• Ability to interpret rubrics and provide precise feedback.
• Experience evaluating large volumes of content.
• Strong written and verbal communication.

Responsibilities

• Evaluate and score AI-generated responses using rubrics and metrics.
• Annotate and categorize data sets to improve model accuracy.
• Review content for relevance, coherence, and factual accuracy.
• Provide clear, actionable feedback to inform model improvements.
• Collaborate with customer’s team to interpret guidelines and refine rubrics.
• Document findings and maintain records of annotations and evaluations.
• Engage in critical reading of topics across business, finance, marketing, healthcare, and legal domains.

Skills

Attention to detail

Analytical skills

Communication skills

Content evaluation

AI training

Remote work capability

Education

Bachelor's degree

Tools

Annotation tools

Job description

YO IT Consulting is seeking an AI Trainer Lead for a remote contract role. You will guide data annotation and evaluation to shape how models learn, reason, and perform across domains. Your expertise will influence rubrics, scoring, and feedback loops with client teams.

The ideal candidate has strong attention to detail, excellent communication, and hands-on experience in AI training or data annotation, with the ability to work independently in a fully remote environment.