Remote AI QA & Model Evaluation Engineer (Flexible Hours)

OpenTrain AI, Inc.; United States; Remote; USD 87,000 - 165,000; Part time

Job summary

OpenTrain AI, Inc. seeks an entry-level contractor to review AI model outputs, datasets and evaluation records, applying project guidelines with clear evidence.

This remote, part-time role offers flexible hours over 1 to 3 months, paying $63–$120 per hour, with estimated earnings of $10,080–$19,200 depending on hours worked. Open to candidates in the United States, Canada, the UK, India, Japan and Brazil. English proficiency must be at B2 or above, with QA/data labeling experience helpful.

Qualifications

• Entry-level contractor role; prior AI training experience not required.
• Strong practical knowledge of software QA, especially test planning and defect reporting.
• English proficiency at B2 level or above.

Responsibilities

• Evaluate model outputs using project rubrics.
• Review source materials and model responses against project guidelines.
• Document evidence-based judgments and explain your reasoning clearly.
• Provide feedback that can help improve model behavior.
• Maintain consistent quality across repeated review tasks.

Skills

Software QA

Test planning

Defect reporting

Data labeling

Annotation

Model evaluation

RLHF

Job description

OpenTrain AI, Inc. seeks an entry-level contractor to review AI model outputs, datasets and evaluation records, applying project guidelines with clear evidence.

This remote, part-time role offers flexible hours over 1 to 3 months, paying $63–$120 per hour, with estimated earnings of $10,080–$19,200 depending on hours worked. Open to candidates in the United States, Canada, the UK, India, Japan and Brazil. English proficiency must be at B2 or above, with QA/data labeling experience helpful.