AI QA Engineer: Training & Evaluation Specialist

OpenTrain AI; Northern (KY); Hybrid; USD 124,000 - 241,000; Full time

Job summary

OpenTrain AI is seeking about 65 QA Engineers for expert contract work on AI training and evaluation projects. Roles involve manual and automated testing, with emphasis on human data tasks such as RLHF and evaluation rating. The project spans 3–6 months with hourly rates between $90 and $175.

Applicants should have hands-on QA experience, clear communication of defects, and English proficiency. This contractor opportunity offers flexible engagement and alignment with ongoing AI research efforts.

Qualifications

• Professional experience as a QA Engineer, Software Tester, Test Engineer, or similar role.
• Prior human-data experience is mandatory for this opportunity.
• Ability to clearly explain testing decisions, defects, and expected behavior.
• English proficiency at B2 level or higher is required.

Responsibilities

• Design and execute high-quality test cases and scenarios.
• Identify, reproduce, document, and analyze defects.
• Perform functional, regression, and other relevant testing activities.
• Review AI-generated testing approaches and outputs for accuracy.
• Evaluate whether proposed solutions address bugs and requirements.
• Provide clear, structured feedback based on QA expertise.
• Contribute to QA-focused datasets and evaluation tasks for AI systems.
• Complete evaluation rating, question answering, RLHF, and related human-data tasks.

Skills

QA testing

Manual testing

Automated testing

Test design

Defect tracking

Regression testing

Analytical skills

English proficiency

Job description

OpenTrain AI is seeking about 65 QA Engineers for expert contract work on AI training and evaluation projects. Roles involve manual and automated testing, with emphasis on human data tasks such as RLHF and evaluation rating. The project spans 3–6 months with hourly rates between $90 and $175.

Applicants should have hands-on QA experience, clear communication of defects, and English proficiency. This contractor opportunity offers flexible engagement and alignment with ongoing AI research efforts.