Company: CODVO.AI
Department: Engineering
Location: Pune, India (Hybrid)
Employment Type: Full-time
Experience Level: Expert (1215+ years)
Shift Timing: 2:30 PM 11:30 PM IST
Work Days: 3 days per week on-site
Role Goal
Provide strategic and operational leadership for a portfolio of high throughput, clinically defensible, audit ready surgical video annotation programs. Own scale, standardization, automation leverage, quality systems, and client trust across multiple programsensuring predictable delivery, regulatory readiness, and measurable ROI on human in the loop operations.
What You'll Do
Portfolio & Delivery Ownership (E2E)
- Own end to end delivery for multiple concurrent surgical video annotation programs across clients, procedures, and modalities.
- Set and enforce standard operating models from intake de identification annotation QA/IRR adjudication dataset release + evidence packs.
- Ensure programs meet or exceed SLAs, quality thresholds, and release timelines at scale.
Operating Model & Standardization
- Define and institutionalize annotation operating standards:
- Program playbooks
- SOPs
- Quality gates
- Evidence pack structure
- Dataset versioning discipline
- Ensure every program is reproducible, auditable, and clinically defensible.
Ontology & Clinical Governance
- Partner with senior clinical SMEs to:
- Define and approve procedure level ontologies (phases, steps, anatomy, tools, events).
- Ensure consistent translation into labeling guidelines, UI constraints, and QA checks.
- Own governance mechanisms to resolve clinical ambiguity, manage guideline evolution, and prevent ontology drift across programs.
Automation First Strategy
- Set the automation vision and roadmap for surgical video labeling:
- Pre labeling + verification as default
- Confidence/uncertainty based task routing
- Active learning feedback loops
- Drive continuous reduction in cost per labeled minute and human effort per release.
- Partner with ML, platform, and data engineering leaders to productionize automation gains.
Quality Systems & Audit Readiness
- Design and govern enterprise grade quality systems:
- Multi rater strategies by label class
- IRR standards (kappa, alpha, IoU/Dice as applicable)
- Calibration and retraining frameworks
- Acceptance thresholds by use case (R&D; vs regulated)
- Ensure every dataset ships with a complete Evidence Pack:
- Provenance
- QA & IRR reports
- Adjudication logs
- Clinical and delivery sign offs
Adjudication & Risk Management
- Own disagreement governance across programs:
- Escalation paths to senior adjudicators and clinicians
- Systematic tracking of ambiguity categories
- Closure of recurring issues via guideline and tooling updates
- Proactively identify delivery, quality, compliance, and reputational risks.
Security, Privacy & Compliance Leadership
- Ensure all annotation programs comply with:
- De identification standards