AI QA Test Engineer - Remote, Data Labeling & Evaluation

YO AI Labs; United States; Remote; USD 34,000 - 69,000; Full time

Job summary

YO AI Labs is seeking a detail-oriented QA Engineer for a remote contractor role focused on quality assurance for AI training data. You will design and execute test cases, review data labeling, and evaluate model outputs to ensure accuracy and reliability.

The ideal candidate has strong analytical skills, solid experience in software QA, and excellent documentation and communication abilities. Remote collaboration with cross-functional teams worldwide is expected.

Qualifications

• Experience in software testing and quality assurance.
• Understanding of test planning and defect reporting.
• Experience with data annotation, RLHF, or AI evaluation is preferred.
• Strong analytical, documentation, and communication skills.

Responsibilities

• Design and execute test cases to validate AI outputs.
• Review, annotate, and label datasets.
• Identify errors and inconsistencies in model predictions.
• Document test results and provide actionable feedback.
• Collaborate with teams to improve testing methodologies.
• Recommend improvements to data quality and model performance.

Skills

Software Quality Assurance

Test Planning and Test Case Design

Data Annotation and Labeling

AI Model Evaluation

Defect Reporting and Documentation

Data Quality and Validation

Analytical Thinking and Attention to D

English Communication (B2 or higher)

Job description

YO AI Labs is seeking a detail-oriented QA Engineer for a remote contractor role focused on quality assurance for AI training data. You will design and execute test cases, review data labeling, and evaluate model outputs to ensure accuracy and reliability.

The ideal candidate has strong analytical skills, solid experience in software QA, and excellent documentation and communication abilities. Remote collaboration with cross-functional teams worldwide is expected.