Remote Data Entry AI Evaluation Designer (Contractor)

OpenTrain AI

Northern (KY)

Hybrid

USD 28,000 - 48,000

Part time

3 days ago

Be an early applicant

Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

OpenTrain AI is seeking a Data Entry AI Evaluation Task Designer to create expert-level evaluation materials for an advanced AI benchmark project. You will translate realistic data entry and validation challenges into structured tasks for AI agents.

The role suits someone experienced in data entry, QA, or data validation within regulated environments. It is a part-time, contractor position with remote work and flexible hours, paying $20-$35 per hour.

Qualifications

Experience in data entry, quality assurance, or data validation in a regulated or audit-sensitive domain.
Ability to document accuracy standards, error rates, and validation outcomes.
Proficient written English.

Responsibilities

Design tasks that simulate real-world data entry and validation.
Construct and curate datasets using CSVs, PDFs, spreadsheets, and technical documents.
Introduce malformed records, missing data, inconsistent formats, and formatting irregularities.
Define the correct final state for each task, including error cases and reconciliation requirements.
Write detailed grading rubrics with 35 or more criteria.
Assess accuracy and completeness against clearly defined standards.
Ensure materials reflect compliance-sensitive environments.
Refine evaluation materials through careful asynchronous communication.