Remote-First Quality Architect for AI Data & Benchmarks

Augmodo; United States; On-site; USD 45,000 - 65,000; Full time

Benefits offered by this job

Medical, Dental, Vision insurance

401k

Remote-first culture

Equity

Job summary

Augmodo is seeking a Quality Specialist to define our quality standards across data annotation and computer vision workflows. You will collaborate with the Computer Vision and Data Operations teams to establish benchmark data and certify annotators.

You will curate gold datasets, monitor drift, and conduct rigorous quality audits while contributing to a remote-first culture that values transparency, speed, and precision.

Qualifications

• 2+ years in data annotation and QA, including calibrating other annotators.
• Experience with Encord or similar annotation platforms; 2D/3D labeling.
• Strong attention to detail to identify edge cases and validate data quality.
• Clear written and verbal communication for cross-functional teams.

Responsibilities

• Curate and maintain gold datasets for benchmarking.
• Create and update training materials and certification tests.
• Monitor drift and calibrate QA metrics for Data Ops Hub.
• Conduct rigorous quality audits across CV datasets.
• Provide high-trust production labeling when critical needs arise.

Skills

Data annotation experience

Quality assurance

Attention to detail

Communication

Tools

Encord

CVAT

Labelbox

SuperAnnotate

Job description

Augmodo is seeking a Quality Specialist to define our quality standards across data annotation and computer vision workflows. You will collaborate with the Computer Vision and Data Operations teams to establish benchmark data and certify annotators.

You will curate gold datasets, monitor drift, and conduct rigorous quality audits while contributing to a remote-first culture that values transparency, speed, and precision.