Remote AI QA Engineer - Technical Evaluator

OpenTrain AI

Brazil, Northern (IN, KY)

Hybrid

USD 83,000 - 154,000

Full time

7 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Remote contract opportunity
Free account creation
Work supporting AI systems development

Job summary

OpenTrain AI is seeking a QA Engineer contractor to review, evaluate, and improve the quality of technical outputs within a remote, expert-level project. The role emphasizes hands-on testing, clear documentation, and adherence to defined rubrics for AI training data quality.

The project runs for 3 to 6 months with pay ranging from $60 to $112 USD per hour. Eligible locations include the United States, United Kingdom, Canada, Germany, Australia, Brazil, and more.

Qualifications

  • Professional QA experience required.
  • Experience with manual and automated testing.
  • Strong bug-tracking and test-management knowledge.

Responsibilities

  • Design and execute test cases for functional, regression, and edge cases.
  • Perform manual and automated testing across outputs.
  • Document testing results with clear, reproducible steps.
  • Identify, log, and track bugs using structured reporting.
  • Evaluate outputs against defined quality criteria and rubrics.
  • Provide detailed written feedback to improve quality.
  • Collaborate to refine evaluation guidelines and testing standards.

Skills

QA Engineer
SDET
Test design
Manual testing
Automated testing
Bug tracking
Attention to detail
Communication

Tools

Bug tracking systems
Test management tools

Job description

OpenTrain AI is seeking a QA Engineer contractor to review, evaluate, and improve the quality of technical outputs within a remote, expert-level project. The role emphasizes hands-on testing, clear documentation, and adherence to defined rubrics for AI training data quality.

The project runs for 3 to 6 months with pay ranging from $60 to $112 USD per hour. Eligible locations include the United States, United Kingdom, Canada, Germany, Australia, Brazil, and more.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI QA Engineer: Training & Evaluation Specialist
AI QA Engineer: Training & Evaluation Specialist

OpenTrain AI • Northern (KY)

Hybrid
USD 124,000 - 241,000
Remote QA Engineer for AI Testing (Contract)
Remote QA Engineer for AI Testing (Contract)

YO AI Labs • New York (NY)

Remote
USD 55,000 - 96,000
QA Engineer AI Training and Evaluation
QA Engineer AI Training and Evaluation

OpenTrain AI • Northern (KY)

Hybrid
USD 124,000 - 241,000
Remote R QA Lead for AI Training & Data Validation
Remote R QA Lead for AI Training & Data Validation

OpenTrain AI • Northern (KY)

Hybrid
USD 5,373,000 - 8,954,000
Remote AI Agent QA & Systems Evaluator (Part-Time)
Remote AI Agent QA & Systems Evaluator (Part-Time)

Mindrift • Mississippi

Remote
USD 55,000 - 75,000
Remote Red-Teaming QA Lead - AI Safety & Evaluation
Remote Red-Teaming QA Lead - AI Safety & Evaluation

OpenTrain AI • United States

On-site
USD 117,000 - 158,000
Remote AI Agent QA Analyst - Flexible, Impactful Evaluation
Remote AI Agent QA Analyst - Flexible, Impactful Evaluation

Mindrift • Houston (TX)

Remote
USD 80,000 - 100,000
Remote AI Agent Evaluator QA Strategist
Remote AI Agent Evaluator QA Strategist

Mindrift • Wisconsin

Remote
USD 60,000 - 80,000
Remote Public-Sector AI Quality Reviewer
Remote Public-Sector AI Quality Reviewer

OpenTrain AI • Northern (KY)

Hybrid
USD 69,000 - 76,000
Remote work
Flexible hours
Part-time contractor
Remote QA Analyst for Autonomous AI Agent Evaluation
Remote QA Analyst for Autonomous AI Agent Evaluation

Mindrift • Austin (TX)

Remote
USD 60,000 - 80,000