Quality Analyst

Thoth AI; Pasig; On-site; PHP 300,000 - 540,000; Full time

Job summary

Thoth AI is seeking a detail-oriented Quality Analyst to support AI/ML data quality through review, labeling, and validation of social media text, images, and video. The role focuses on accuracy, judgment, and cultural/contextual awareness to improve model understanding of language and visuals.

Responsibilities include auditing data against client policies, reviewing audio annotations, and maintaining quality dashboards.

Qualifications

• Requires college-level education or equivalent.
• Fluent in English and Tagalog; strong grammar and regional idioms.
• Excellent attention to detail and listening skills.
• Strong analytical thinking and ability to report performance.
• Familiar with Sheets/Excel for metrics tracking.

Responsibilities

• Audit annotated data regularly and document findings per client policies.
• Review audio annotations for accuracy and detect background noises.
• Analyze quality trends, identify recurring errors, and recommend actions.
• Participate in calibration sessions to align scoring and policy interpretation.
• Provide constructive feedback to annotators and team leads.

Skills

Attention to detail

Analytical thinking

Bilingual English/Tagalog

Data-driven

Communication

Education

College-level or equivalent

Tools

Google Sheets

Microsoft Excel

Job description

We are looking for detail-oriented Quality Analyst to support the development and improvement of AI and machine learning systems. You will review, label, and validate social media text, images, and videos to help AI models better understand language, visual content, and real-world interactions. The role requires accuracy, sound judgment, and strong cultural and contextual awareness.

Key responsibilities

• Conduct regular and ad hoc audits of annotated and labelled data, including applicable content moderation decisions, and document findings against client policies and project guidelines.
• Review audio and related annotations for accuracy, detecting subtle background noises, audio artifacts, and minor deviations from scripts.
• Analyze datasets and quality trends, identify recurring errors, perform root cause analysis, and recommend corrective actions.
• Participate in calibration sessions to align scoring and policy interpretation across teams; escape unclear guidelines and quality or policy risks.
• Provide objective, actionable feedback to annotators, moderators, and Team Leaders to support performance improvement.
• Maintain quality dashboards and metric trackers, prepare comprehensive performance reports, and communicate findings to leadership.
• Follow data privacy, confidentiality, and information security requirements when handling project data.

Qualifications

• College-level or equivalent.
• Native or bilingual fluency in Tagalog and English, with an excellent grasp of grammar, syntax, and regional idioms in both languages. English proficiency must be at least B2.
• Exceptional attention to detail and listening skills, including the ability to detect subtle audio issues and script deviations.
• Strong analytical thinking, objective interpretation of guidelines, and the ability to identify trends and develop clear performance reports.
• Familiarity with Google Sheets or Microsoft Excel for tracking quality metrics, and comfort learning QA, audio playback, and annotation tools.
• Professional, polite written and verbal communication skills, with the ability to deliver clear constructive feedback.
• Demonstrated subject matter expertise or team support capabilities.

Preferred experience

• Experience in data annotation, labelling, content moderation, or related fields.
• BPO experience, preferably in data-driven accounts or projects.
• Experience in quality auditing or policy enforcement.