AI Annotation Quality Reviewer

Gramian Consulting; Brasil; Remote; BRL 174,000 - 348,000; Part time

Job summary

Gramian Consultancy seeks a detail-oriented QA Review Team Lead to oversee quality assurance for AI training data. You will lead QA reviewers, manage audit queues, assess annotation quality, and provide clear feedback to improve team performance.

You will train new reviewers, clarify guidelines, and escalate complex cases to the Senior QA Lead while driving continuous improvement across the project. Remote work across Brazil, Colombia, and India is available for 16 weeks.

Qualifications

• 3-5 years of QA experience, with at least 1 year in leading or supervising reviewers
• Strong attention to detail and ability to apply complex guidelines consistently
• Excellent written and verbal communication skills
• Capable of providing constructive, actionable feedback and clarifying quality expectations
• Strong organizational skills to manage multiple review queues and deadlines
• Ability to identify patterns in errors and suggest corrective actions
• Availability to work the specified schedule for the full 16-week project

Responsibilities

• Lead QA reviewers and manage audit and review queues to ensure timely and accurate completion of assigned work
• Spot-check annotated data and reviewer decisions to verify compliance with project guidelines and quality standards
• Provide clear, actionable, and consistent feedback to reviewers and annotators
• Conduct office hours and clarify annotation guidelines, review criteria, and quality expectations
• Monitor quality scores, error trends, audit results, and reviewer performance
• Train and onboard new reviewers on project guidelines, tools, and review procedures
• Identify recurring errors and propose corrective actions to improve processes
• Escalate persistent quality issues to the Senior QA Lead
• Support continuous improvement of review processes and maintain consistent quality across the team

Skills

Attention to detail

Communication

Leadership

Feedback delivery

Organizational skills

Mentoring

Quality assurance

Job description

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About The Role

We are seeking a detail-oriented QA Review Team Lead to oversee quality assurance activities for AI training data and ensure annotated outputs are accurate, consistent, and delivered on time. In this role, you will lead QA reviewers, manage audit and review queues, assess annotation quality, identify recurring errors, and provide clear, actionable feedback to improve team performance. You will also train new reviewers, clarify guidelines for annotators, and escalat

CONTRACT:

Contractor assignment, 16 weeks

COMMITMENT:

Hourly, up to 40h/week

LOCATIONS:

Remote - Brazil, Colombia, India

Key Responsibilities

• Lead QA reviewers and manage audit and review queues to ensure timely and accurate completion of assigned work
• Spot-check annotated data and reviewer decisions to verify compliance with project guidelines and quality standards
• Provide clear, actionable, and consistent feedback to reviewers and annotators
• Conduct office hours and clarify annotation guidelines, review criteria, and quality expectations
• Monitor quality scores, error trends, audit results, and reviewer performance
• Train and onboard new reviewers on project guidelines, tools, and review procedures
• Identify recurring errors, inconsistencies, and process gaps, and recommend corrective actions
• Escalate persistent quality issues, unclear guidelines, and complex cases to the Senior QA Lead
• Support continuous improvement of review processes and maintain consistent quality across the team

Requirements

• 3-5 years of overall professional experience, including at least 1 year of experience leading, mentoring, or supervising reviewers or team members
• Strong attention to detail and the ability to apply complex guidelines consistently
• Excellent written and verbal communication skills
• Ability to provide constructive, actionable feedback and explain quality expectations clearly
• Strong organizational skills and the ability to manage multiple review queues and competing deadlines
• Ability to identify patterns in errors and support corrective actions
• Availability to work the specified schedule for the full 16-week project