AI Data Quality Specialist - English (Philippines)

Welo Global; United States; Remote; USD 5,500 - 8,300; Part time

Job summary

Welo Global is seeking a detail-oriented AI Data Quality & Annotation Specialist to develop and evaluate large language models. You will review English language content to assess sentiment accuracy, factual consistency, and reasoning quality using structured guidelines.

The role requires advanced English proficiency, sharp analytical skills, and the ability to apply labeling standards consistently across high volumes of tasks.

Qualifications

• Advanced English proficiency (reading and writing) with professional-level fluency.
• Strong comprehension and written justification skills.
• Experience in data annotation or AI training projects.
• Preferred background in linguistics, journalism, or research.
• Exceptional attention to detail and consistent decision-making.
• Familiarity with AI systems or LLM evaluation is a plus.

Responsibilities

• Review and label content for sentiment, factual accuracy, and reasoning issues.
• Evaluate model outputs across quality dimensions using scoring frameworks.
• Validate automated assessments and identify discrepancies or errors.

Job description

Contract Type: Freelance

Language: English (Philippines)

About the Role

We are seeking a detail-oriented AI Data Quality & Annotation Specialist to help develop and evaluate large language models (LLMs). Your role will involve reviewing English language content to assess sentiment accuracy, factual consistency, and reasoning quality using structured guidelines. This position is ideal for individuals with sharp analytical skills, attention to detail, and the ability to consistently apply labeling standards.

What You Will Do:

• Review and label content for sentiment, factual accuracy, and reasoning issues.
• Evaluate model outputs across quality dimensions using scoring frameworks.
• Validate automated assessments and identify discrepancies or errors.

Requirements:

• Advanced English proficiency (reading and writing) with professional-level fluency.
• Strong comprehension and articulation skills, with the ability to provide clear and well-reasoned written justifications.
• Previous experience in data annotation, AI training, or related projects.
• Preferred experience in analytical fields such as linguistics, journalism, research, or similar domains.
• Exceptional attention to detail and accuracy.
• Proven analytical reasoning and critical thinking abilities.
• Consistency in decision-making across high volumes of tasks.
• Familiarity with AI systems, large language models (LLMs), or evaluation processes (preferred but not required).

$4.50 - $4.50 an hour