Remote Data Annotation & QA Specialist

Docplanner; United States; Hybrid; USD 65,000 - 90,000; Full time

Benefits offered by this job

Healthcare insurance

Wellness programs

Time off & vacation

Remote work options

Global office hubs

Job summary

Docplanner is seeking a detail-oriented QA/annotation specialist to design, automate and monitor QA workflows across multiple projects. You will work with labeling interfaces in Label Studio, create clear guidelines, onboard freelance annotators, and produce concise summaries for leadership while supporting data analysis and AI quality validation initiatives.

You will operate in a global, flexible environment with remote options and hub locations, contributing to a scalable QA program and

Qualifications

• Comfort working with data, ability to build spreadsheet models and interpret quality metrics.
• Strong written communication and structured thinking for writing guidelines that annotators follow.
• Proven experience coordinating freelancers, vendors, cross-functional partners to deadlines.
• Self-directed with ability to own an area and run it independently.
• Fluent English and working fluency in Italian, Portuguese or Polish.

Responsibilities

• Design, automate, and run QA workflows with sampling, metrics, dashboards and throughput reporting to quantify quality across projects.
• Support in building and maintaining labeling interfaces in Label Studio; configure projects, layouts and improve annotation speed and accuracy.
• Write clear, testable annotation guidelines and maintain a library of guidelines and project docs.
• Source, onboard and coordinate freelance annotators with the AI Annotations Lead; track deadlines and deliverables.
• Turn annotation output and project data into simple, decision-useful summaries for leads or stakeholders.
• Assist with data analysis and reporting to track project health and quality.
• Participate in designing programs to validate the quality of AI systems.

Skills

Data analysis

Python / pandas

Written communication

Project coordination

Self-management

English + other languages

Tools

Label Studio

Excel

Job description

Docplanner is seeking a detail-oriented QA/annotation specialist to design, automate and monitor QA workflows across multiple projects. You will work with labeling interfaces in Label Studio, create clear guidelines, onboard freelance annotators, and produce concise summaries for leadership while supporting data analysis and AI quality validation initiatives.

You will operate in a global, flexible environment with remote options and hub locations, contributing to a scalable QA program and