Senior Image Annotation Protocol Specialist

Agile Automations; Abu Dhabi; Remote; AED 120,000 - 180,000; Full time

Benefits offered by this job

Remote work

Competitive pay

Professional development

Global collaboration

Job summary

Agile Automations Limited seeks a Senior Image Annotation Protocol Specialist to develop and maintain annotation standards for image datasets used in AI and ML. You will define labeling rules, quality KPIs, and robust guidelines to ensure consistent datasets for model training and evaluation.

This fully remote role offers a challenging environment with global collaboration across engineers, data scientists, and annotation teams, focusing on accuracy, scalability, and best practices in annotation

Qualifications

• Bachelor's or master's degree in Computer Science, Data Science, AI, CV, IT or related field.
• Significant experience in image annotation, visual data QA or CV dataset management.
• Experience building annotation guidelines, taxonomies and quality controls.
• Familiarity with annotation platforms like CVAT/Label Studio/Supervisely.
• Understanding of COCO, Pascal VOC export formats.
• Proficiency in Python for dataset inspection and QA.

Responsibilities

• Design, develop, and maintain standardized image annotation protocols for computer vision projects.
• Establish guidelines for classification, object detection, segmentation, keypoints, and bounding-box annotation.
• Define labeling rules, taxonomies, edge-case handling, and acceptance criteria.
• Evaluate annotation consistency, completeness, accuracy, and adherence to standards.
• Review datasets for errors, omissions, and ambiguous classifications.
• Develop QA frameworks, sampling methods, and performance metrics.
• Collaborate with CV engineers, ML researchers, data scientists, and annotation teams.
• Create reference datasets and gold-standard annotations for QC.
• Provide training and guidance to annotation specialists and reviewers.
• Recommend process improvements for accuracy and efficiency.

Skills

Image annotation

Quality assurance

Python

Inter-annotator agreement

Stakeholder communication

Education

Bachelor's or Master's in Computer Science / Data Science

Tools

CVAT

Label Studio

Supervisely

Job description

Job Title: Senior Image Annotation Protocol Specialist

Location: United Arab Emirates (Remote)

Employment Type: Full-Time

Work Arrangement: 100% Remote — Work From Home

Level: Senior

About the Role

We are seeking a Senior Image Annotation Protocol Specialist to develop, maintain, and evaluate annotation standards for image datasets used in computer vision, artificial intelligence, and machine learning applications. The role focuses on creating consistent annotation guidelines, improving labeling accuracy, managing quality assurance processes, and ensuring that visual datasets meet technical and operational requirements.

The successful candidate will combine expertise in image annotation methodologies, computer vision data requirements, quality evaluation, and protocol development to support reliable AI model training and validation.

Key Responsibilities

• Design, develop, and maintain standardized image annotation protocols for computer vision projects.
• Establish clear guidelines for image classification, object detection, segmentation, keypoint identification, and bounding-box annotation.
• Define labeling rules, category taxonomies, edge-case handling procedures, and annotation acceptance criteria.
• Evaluate annotation consistency, completeness, accuracy, and adherence to project-specific standards.
• Review annotated image datasets and identify labeling errors, inconsistencies, omissions, and ambiguous classifications.
• Develop quality assurance frameworks, sampling methodologies, and annotation performance metrics.
• Establish procedures for resolving disagreements between annotators and improving inter-annotator agreement.
• Assess annotation tools and recommend improvements to labeling workflows and review processes.
• Collaborate with computer vision engineers, machine learning researchers, data scientists, and annotation teams.
• Create reference datasets, benchmark examples, and gold-standard annotations for quality assessment.
• Review annotation requirements for complex visual scenarios, including occlusion, overlapping objects, low-resolution images, and unusual perspectives.
• Monitor annotation quality trends and identify recurring issues requiring protocol updates or additional training.
• Develop documentation covering annotation workflows, quality standards, version control, and change management.
• Support audits of labeled datasets and prepare detailed quality evaluation reports.
• Provide technical training, guidance, and feedback to annotation specialists and quality reviewers.
• Recommend process improvements that increase annotation accuracy, consistency, and operational efficiency.

Qualifications and Experience

• Bachelor's or master's degree in Computer Science, Data Science, Artificial Intelligence, Computer Vision, Information Technology, or a related discipline.
• Significant professional experience in image annotation, visual data quality assurance, or computer vision dataset management.
• Strong understanding of image labeling methodologies, including classification, object detection, semantic segmentation, and instance segmentation.
• Experience developing annotation guidelines, labeling taxonomies, and quality control procedures.
• Familiarity with image annotation platforms and tools such as CVAT, Label Studio, Supervisely, or comparable solutions.
• Understanding of computer vision model training and the role of accurately labeled datasets in model performance.
• Knowledge of bounding boxes, polygons, masks, keypoints, landmarks, and other visual annotation formats.
• Experience evaluating annotation consistency and measuring inter-annotator agreement.
• Ability to identify ambiguous visual content, labeling bias, incomplete annotations, and dataset quality issues.
• Familiarity with image formats, metadata, dataset organization, and annotation export formats such as COCO and Pascal VOC.
• Experience using Python or related tools for dataset inspection, validation, and quality analysis.
• Strong analytical, documentation, and problem-solving skills.
• Excellent communication and stakeholder coordination abilities.
• Ability to manage multiple projects and work independently in a fully remote environment.

What We Offer

• 100% remote working arrangement from within the applicable employment jurisdiction.
• Competitive compensation aligned with experience and specialist expertise.
• Opportunities to contribute to advanced computer vision and artificial intelligence projects.
• Professional development and exposure to evolving image annotation technologies and methodologies.
• A collaborative environment involving multidisciplinary and international teams.