Quality Lead, DataOps - Audit & Training Champion

iMerit Inc.; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

iMerit Inc. seeks a Quality Lead - DataOps to own quality outcomes for annotation pipelines. You will translate training standards into day-to-day enforcement, analyze error trends, and partner with Trainers and Team Leads to drive calibration and coaching.

You will work with cross-functional partners to evolve guidelines, share insights with clients, and maintain rigorous quality reporting that supports client SLAs and account success.

Qualifications

• 3+ years as a Team Lead, senior annotator, or QA reviewer within an annotation/DataOps pipeline.
• Strong grasp of the pipeline's guidelines and edge cases; able to make and defend judgment calls on ambiguous data.
• Comfortable working in spreadsheets/dashboards to analyze error trends (Excel/Sheets required; SQL or BI tool experience a plus).
• Clear written and verbal communication for coaching feedback and calibration sessions.
• Experience giving feedback to peers or Team Members without formal management authority.

Responsibilities

• Own the quality audit cadence for the pipeline: sampling plans, QA reviews, and accuracy/precision scoring against client rubrics.
• Run root-cause analysis on quality misses and defects, distinguishing training gaps, tooling issues, guideline ambiguity, and individual performance issues.
• Partner with the Trainer to translate recurring error patterns into updated training materials, calibration sessions, and onboarding content, and join the Trainer in bringing findings to the client for discussion.
• Track training rollout and resulting adjustments against the quality goal, and tighten the feedback loop between findings, training, and measured progress.
• Partner with Team Leads to deliver targeted coaching to Team Members, using QA data to prioritize who and what gets coached.
• Maintain and evolve quality guidelines/rubrics in response to client feedback, guideline changes, or edge cases surfaced from the floor.
• Run calibration sessions across Team Leads and reviewers to keep scoring consistent pipeline-wide.
• Report quality metrics and trends to DataOps leadership and the Project Manager, flagging systemic risk before it affects client-facing quality SLAs.
• Represent quality in client-facing reporting and audits alongside the Project Manager when needed.

Job description

iMerit Inc. seeks a Quality Lead - DataOps to own quality outcomes for annotation pipelines. You will translate training standards into day-to-day enforcement, analyze error trends, and partner with Trainers and Team Leads to drive calibration and coaching.

You will work with cross-functional partners to evolve guidelines, share insights with clients, and maintain rigorous quality reporting that supports client SLAs and account success.