Quality Benchmark Lead for AI Data & Annotations (Remote)

Augmodo; Seattle (WA); On-site; USD 45,000 - 65,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

401k

Job summary

Augmodo is seeking a Quality Specialist to define and uphold our quality standards across data annotation and AI workflows. You will partner with Computer Vision and Data Operations teams to set benchmarks, review edge cases, and ensure production labeling meets P0 priorities.

You will curate golden datasets, create training materials, monitor drift, and conduct double-blind audits to maintain a gold standard for our spatial AI datasets.

Qualifications

• 2+ years in data annotation and QA, including reviewing others' work.
• Experience with enterprise annotation platforms (Encord or similar).
• Ability to calibrate annotators and define quality standards.
• Strong documentation and cross-functional collaboration skills.

Responsibilities

• Define and uphold quality standards across datasets and labeling workflows.
• Create and update training materials and certification tests for onboarding.
• Periodically evaluate annotators against benchmark data to monitor drift.
• Conduct rigorous, double-blind quality audits for gold-standard datasets.
• Serve as high-trust annotator for production labeling when needed.

Skills

Experience in data annotation

Judgment & attention to detail

Communication

Quality assurance mindset

Tools

Encord

CVAT

Labelbox

SuperAnnotate

Job description

Augmodo is seeking a Quality Specialist to define and uphold our quality standards across data annotation and AI workflows. You will partner with Computer Vision and Data Operations teams to set benchmarks, review edge cases, and ensure production labeling meets P0 priorities.

You will curate golden datasets, create training materials, monitor drift, and conduct double-blind audits to maintain a gold standard for our spatial AI datasets.