AV Annotation Quality Lead | Audit, Calibration, Coaching

iMerit Inc.; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

iMerit Inc. is seeking a Quality Lead to own quality outcomes across an annotation pipeline. The role interfaces with Trainers and Team Leads to convert training standards into daily quality enforcement, using audits, calibration, and root-cause analysis to drive improvements.

The position emphasizes coaching, guideline refinement, and client-facing reporting. Strong communication, data analysis skills, and experience with Excel/Sheets are essential.

Qualifications

• 1+ years as a Team Lead, senior annotator, or QA reviewer within an annotation/DataOps pipeline.
• Strong grasp of the pipeline's guidelines and edge cases; able to make and defend judgment calls on ambiguous data.
• Comfortable working in spreadsheets/dashboards to analyze error trends (Excel/Sheets required; SQL or BI tool experience a plus).
• Clear written and verbal communication for coaching feedback and calibration sessions.
• Experience giving feedback to peers or Team Members without formal management authority.

Responsibilities

• Own the quality audit cadence for the pipeline: sampling plans, QA reviews, and accuracy/precision scoring against client rubrics.
• Run root-cause analysis on quality misses and defects, distinguishing training gaps, tooling issues, guideline ambiguity, and individual performance issues.
• Partner with the Trainer to translate recurring error patterns into updated training materials, calibration sessions, and onboarding content, and join the Trainer in bringing findings to the client for discussion.
• Track training rollout and resulting adjustments against the quality goal, and tighten the feedback loop between findings, training, and measured progress.
• Partner with Team Leads to deliver targeted coaching to Team Members, using QA data to prioritize who and what gets coached.
• Maintain and evolve quality guidelines/rubrics in response to client feedback, guideline changes, or edge cases surfaced from the floor.
• Run calibration sessions across Team Leads and reviewers to keep scoring consistent pipeline-wide.
• Report quality metrics and trends to DataOps leadership and the Project Manager, flagging systemic risk before it affects client-facing quality SLAs.
• Represent quality in client-facing reporting and audits alongside the Project Manager when needed.

Skills

Team leadership

Quality assurance

Data analysis

Communication

Feedback & coaching

Tools

Excel/Sheets

SQL

BI tools

Job description

iMerit Inc. is seeking a Quality Lead to own quality outcomes across an annotation pipeline. The role interfaces with Trainers and Team Leads to convert training standards into daily quality enforcement, using audits, calibration, and root-cause analysis to drive improvements.

The position emphasizes coaching, guideline refinement, and client-facing reporting. Strong communication, data analysis skills, and experience with Excel/Sheets are essential.