QA Lead/QA Exec

Agensi Pekerjaan Penta Consultancy Sdn. Bhd; Kuala Lumpur; On-site; MYR 100,000 - 150,000; Full time

Job summary

A recruitment consultancy based in Malaysia is seeking a Quality Assurance Team Lead to manage QAs for audio, video, and LLM projects. The ideal candidate will have a Bachelor's degree and 3-5 years of experience in QA or data labeling, with strong analytical and communication skills. Responsibilities include leading a QA team, conducting calibration sessions, analyzing QA reports, and supporting new project launches through quality validation processes. Competitive salary and opportunities for continuous improvement initiatives are offered.

Qualifications

• 3-5 years of experience in data labeling, quality assurance, or content review.
• Track record in managing QA teams and driving performance improvements.
• Familiarity with annotation tools and QA platforms.

Responsibilities

• Lead and manage a team of QAs ensuring quality objectives are met.
• Conduct calibration sessions with QAs, Trainers, and PMs.
• Analyze QA reports and recommend corrective actions.

Skills

Analytical and problem-solving skills

Communication and collaboration

Experience in QA team management

Education

Bachelor's degree in Linguistics, Data Science, Computer Science, Engineering, or a related field

Tools

Airtable

Smartsheet

Jira

Labelbox

Job description

• Lead and manage a team of QAs within the assigned project domain (Audio / Video / LLM), ensuring quality objectives and SLAs are consistently met.
  
• Develop and standardize QA rubrics, error typologies, and review guidelines based on project-specific annotation requirements.
  
• Conduct calibration sessions regularly with QAs, Trainers, and PMs to maintain consistent quality interpretations across teams.
  
• Analyze QA reports and annotation error trends to identify systemic issues and recommend corrective actions.
  
• Collaborate with Trainers to translate recurring quality gaps into targeted training or retraining plans.
  
• Perform quality audits on both QA and annotator performance to ensure review accuracy and reliability.
  
• Monitor and report key quality metrics (Accuracy, Consistency, Disagreement Rate, Rejection Rate, etc.) to stakeholders.
  
• Design and optimize QA sampling strategies to ensure efficient yet effective quality coverage.
  
• Support new project launches by developing quality validation processes, test datasets, and pilot evaluation rubrics.
  
• Drive continuous improvement initiatives through process standardization, tool optimization, and cross-domain knowledge sharing.
  
• Ensure data integrity and confidentiality in line with client and internal security requirements.
  

Job Requirements

• Bachelors degree in Linguistics, Data Science, Computer Science, Engineering, or a related field.
• 3~5 years of experience in data labeling, quality assurance, or content review (preferably in AI data operations).
• Proven track record in managing QA teams and driving performance improvements.
• Strong analytical and problem-solving skills; able to interpret large sets of QA and error data.
• Excellent communication and collaboration skills; able to align QA, training, and delivery stakeholders.
• Familiarity with annotation tools, QA platforms, and performance tracking dashboards (e.g., Airtable, Smartsheet, Jira, Labelbox, etc.).

Preferred

• Prior experience in Audio, Video, or LLM annotation quality management.
• Knowledge of process improvement methodologies (Six Sigma, Kaizen, or equivalent).
• Experience designing QA rubrics and calibration frameworks.
• Background in AI data services, MLOps, or data quality governance.