ML Data Quality Lead for Datasets

Humxn; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Humxn is seeking a role focused on defining and enforcing quality for ML datasets. You will design rubrics, guidelines, and acceptance criteria so experts apply them consistently, run qualification and review processes, and measure agreement and error rates per batch.

You will investigate quality issues and drive root-cause fixes, collaborating with buyers' research teams to align on what “good” means for their models.

Qualifications

• Experience running annotation, evaluation or data-quality programs for ML.
• Comfort with basic statistics for agreement and sampling.
• Clear, precise writing; guidelines are a product.

Responsibilities

• Turn dataset specs into rubrics, guidelines and acceptance criteria experts can apply consistently.
• Run qualification and review processes, and measure agreement and error rates per batch.
• Investigate quality issues and fix root causes from unclear guidelines to wrong expert match.
• Partner with buyers' research teams on what “good” means for their models.

Skills

Annotation programs

Statistics basics

Technical writing

Job description

Humxn is seeking a role focused on defining and enforcing quality for ML datasets. You will design rubrics, guidelines, and acceptance criteria so experts apply them consistently, run qualification and review processes, and measure agreement and error rates per batch.

You will investigate quality issues and drive root-cause fixes, collaborating with buyers' research teams to align on what “good” means for their models.