AI Evaluator

Jobtailor; Pakistan; On-site; PKR 1,200,000 - 2,200,000; Full time

Job summary

Jobtailor is seeking a detail-oriented evaluation specialist to analyze and annotate AI-generated content, ensuring accuracy, relevance and clarity across projects. You will apply project-specific guidelines to review outputs and flag issues early.

You will identify errors, inconsistencies, weak reasoning, and missing information, and provide clear, actionable feedback. Collaboration with data, product, and QA teams will help raise overall quality and consistency in our deliverables.

Qualifications

• Excellent written and spoken English.
• Strong critical-thinking and analytical skills.
• Ability to evaluate information and identify logical or factual problems.

Responsibilities

• Analyze and evaluate a variety of data and AI-generated content.
• Annotate information according to project-specific guidelines.
• Review AI outputs for accuracy, relevance, clarity, and quality.
• Identify errors, inconsistencies, weak reasoning, and missing information.
• Provide clear written feedback and recommendations.
• Complete problem-solving and reasoning tasks across different subject areas.
• Follow detailed project guidelines and evaluation criteria consistently.
• Participate in quality-assurance and review processes.
• Communicate findings and issues clearly with the project team.
• Maintain high attention to detail across assigned tasks.

Skills

Data Analysis

AI Content Evaluation

Critical Thinking

Attention to Detail

Written Communication

Tools

Data Evaluation

Content Annotation

Quality Assurance

Problem Solving

Reasoning Tasks

Job description

• Analyze and evaluate a variety of data and AI-generated content
• Annotate information according to project-specific guidelines
• Review AI outputs for accuracy, relevance, clarity, and quality
• Identify errors, inconsistencies, weak reasoning, and missing information
• Provide clear written feedback and recommendations
• Complete problem-solving and reasoning tasks across different subject areas
• Follow detailed project guidelines and evaluation criteria consistently
• Participate in quality-assurance and review processes
• Communicate findings and issues clearly with the project team
• Maintain high attention to detail across assigned tasks

Requirements

• Excellent written and spoken English
• Strong critical-thinking and analytical skills
• Ability to evaluate information and identify logical or factual problems

Core Competencies

Demonstrates strong analytical and critical-thinking skills to evaluate data and AI-generated content, ensuring accuracy and clarity while providing constructive feedback. Maintains attention to detail and follows project-specific guidelines to deliver high-quality results.

Highest-signal resume keywords

• Data Analysis
• AI Content Evaluation
• Critical Thinking
• Attention to Detail
• Written Communication

Hard Skills

• Data Evaluation
• Content Annotation
• Quality Assurance
• Problem Solving
• Reasoning Tasks

Soft Skills

• Analytical Skills
• Communication Skills

Industry Keywords

• Project Guidelines
• Evaluation Criteria
• Feedback
• Accuracy
• Relevance
• Clarity
• Quality