Quality Operations Lead Contract

Dover; India; Remote; INR 7,605,000 - 10,456,000; Part time

Job summary

Careerflow Human Data Labs is seeking a Senior QA lead to manage day-to-day quality operations for multimodal AI annotation projects. You will lead QA teams, monitor quality, and ensure deliverables meet client standards with tight turnaround times.

Reporting to the Quality Manager, you will implement audits, scoring rubrics, calibration, track metrics, resolve issues, and share insights after each delivery.

Qualifications

• 5–7 years of overall experience, including 2–3 years leading QA or quality operations teams.
• Strong knowledge of sampling, auditing, calibration, and root-cause analysis.
• Excellent attention to detail and ability to identify systemic issues.
• Strong communication and stakeholder-management skills.
• Experience in annotation, data labeling, or AI training data projects preferred.

Responsibilities

• Lead Senior QA Leads and QA Leads across shifts.
• Set review priorities, sampling plans, and quality coverage.
• Implement audits, scoring rubrics, and calibration processes.
• Track accuracy, agreement, error rates, review throughput, and turnaround time.
• Identify root causes and drive corrective actions with Team Leads.
• Resolve guideline-related questions and document decisions.
• Share quality insights after each delivery.
• Report quality performance to the Quality Manager.
• Support client reviews and quality-based incentive programs.

Skills

QA leadership

Quality operations

Root-cause analysis

Attention to detail

Stakeholder management

Auditing

Job description

Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products.

About the role

Manage day-to-day quality operations for multimodal AI annotation projects. Reporting to the Quality Manager, you will lead QA teams, monitor quality performance, resolve issues quickly, and ensure deliverables meet client standards within tight turnaround times.

Key Responsibilities

• Lead Senior QA Leads and QA Leads across shifts.

• Set review priorities, sampling plans, and quality coverage.

• Implement audits, scoring rubrics, and calibration processes.

• Track accuracy, agreement, error rates, review throughput, and turnaround time.

• Identify root causes and drive corrective actions with Team Leads.

• Resolve guideline-related questions and document decisions.

• Share quality insights after each delivery.

• Report quality performance to the Quality Manager.

• Support client reviews and quality-based incentive programs.

Required Qualifications

• 5–7 years of overall experience, including 2–3 years leading QA or quality operations teams.

• Strong knowledge of sampling, auditing, calibration, and root-cause analysis.

• Excellent attention to detail and ability to identify systemic issues.

• Strong communication and stakeholder-management skills.

• Experience in annotation, data labeling, or AI training data projects is preferred.

Offer Details:

1. This is a project-based role involving a defined number of evaluation tasks.

2. Each task will involve comparing multiple chatbots and providing a final assessment.

3. Work Schedule: Five working days per week, including weekends as required, with two weekdays off.

4. Work Hours - 7am-4pm PST

5. Duration: 16 weeks.