QA Auditor (Sampling, Quality Gates, Release Readiness)

Codvo Private Limited; Pune District; On-site; INR 900,000 - 1,500,000; Full time

Job summary

A forward-thinking technology company based in Pune is looking for a QA Auditor to ensure dataset quality through effective auditing and sampling processes. You will work on maintaining quality gates, generating audit reports, and collaborating with teams to resolve quality issues. The ideal candidate has 3–7+ years of experience in data QA and strong documentation skills. This full-time role offers the opportunity to be part of a dynamic team focused on innovation and quality control.

Qualifications

• 3–7+ years in data QA, with experience auditing labeled datasets.
• Strong command of sampling methods and audit scoring.
• Detail-oriented, with the ability to enforce SOPs and guidelines.
• Strong documentation skills; can write clear defect descriptions and rework instructions.
• Comfortable with dashboards/spreadsheets; basic metric literacy (defect density, rework, throughput).

Responsibilities

• Execute sampling plans for QA and release audits.
• Audit annotations against guidelines, scoring defects.
• Maintain QA dashboards and support release readiness.
• Generate rework tickets with precise instructions; track closure and verify fixes.
• Partner with Annotation Lead to drive calibration actions (training refreshers, guideline clarifications).
• Maintain QA dashboards: defect rate, rework %, gate pass rate, audit cycle time.
• Support release readiness: ensure artifacts are complete for the Evidence Pack.

Skills

Sampling-based QA

Attention to detail

Documentation skills

Metric literacy

Documentation

Tools

Spreadsheets

QA Tools

Job description

Job Title: QA Auditor (Sampling, Quality Gates, Release Readiness)

JD: QA Auditor — Surgical Video Annotation (Sampling, Quality Gates, Release Readiness)

Location: India - Pune | Type: Full-time

Reports to: Quality Lead / Program Lead

About Us

At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.

Role goal

Protect dataset quality at scale by running sampling-based audits, enforcing quality gates, and ensuring every dataset release is audit-ready and meets acceptance thresholds.

Responsibilities

• Execute sampling plans (stratified by label type, difficulty, site/surgeon/device, model confidence) for ongoing QA and release audits.
• Audit annotations against guidelines + ontology; score defects using standardized rubrics (severity, type, root cause).
• Run and validate quality gates prior to release:
  • completeness/coverage checks
  • schema/constraint checks (illegal combinations, temporal consistency, boundary rules)
  • defect density and rework thresholds
• Generate rework tickets with precise instructions; track closure and verify fixes.
• Partner with Annotation Lead to drive calibration actions (training refreshers, guideline clarifications, examples library).
• Maintain QA dashboards: defect rate, rework %, gate pass rate, audit cycle time, top error patterns by annotator/team/label type.
• Support release readiness: ensure required artifacts are complete for the Evidence Pack (QA results, sampling logs, sign-offs).
• Escalate systematic issues to Adjudication/Clinical Review (definition gaps, ambiguous classes, recurring edge cases).
• Deliverables (what you produce weekly):
  • QA audit reports (sample size, findings, severity distribution, root-cause categories)
  • Gate status + release checklist sign-off recommendations
  • Rework queue and closure verification
  • Trend insights and corrective action plan (top 3 issues + fixes)

Requirements

• 3–7+ years in data QA / annotation QA / operations quality; experience auditing labeled datasets (video preferred).
• Strong command of sampling-based QA: stratified sampling, acceptance thresholds, and audit scoring.
• High attention to detail; comfortable reading and enforcing detailed SOPs/guidelines.
• Strong documentation skills; can write clear defect descriptions and rework instructions.
• Comfortable with dashboards/spreadsheets; basic metric literacy (defect density, rework, throughput).

Note- Please apply via our official careers portal only, as applications sent directly to executives may not be considered.