Remote QA Engineer for AI Data & Model Evaluation

micro1; United States; Remote; USD 60,000 - 90,000; Part time

Job summary

micro1 is seeking a QA Engineer for a remote contractor role focused on AI training data quality. You will design and execute tests to validate AI outputs, annotate datasets to improve model training, and evaluate predictions for errors and patterns.

Collaboration with cross-functional teams will shape project requirements and testing strategies. Ideal candidates have hands-on QA experience, data labeling or RLHF exposure, and English at B2 level or higher to report findings clearly.

Qualifications

• Hands-on expertise in software quality assurance, with test planning and defect reporting.
• Experience with data labeling, annotation, RLHF, or model evaluation.
• Proficiency in English at B2 level or above.

Responsibilities

• Design, execute, and document test cases and scenarios to validate AI outputs against defined requirements.
• Review, annotate, and label data sets to enhance machine learning model training accuracy.
• Evaluate, analyze, and report on model predictions, identifying inconsistencies, errors, or patterns for continuous improvement.
• Collaborate with cross-functional teams to communicate findings and clarify project requirements.
• Contribute to the development and refinement of testing methodologies specific to AI-driven systems.
• Maintain detailed, organized records of evaluations, test results, and feedback through written documentation.
• Provide actionable recommendations to optimize data quality and model performance.

Job description

micro1 is seeking a QA Engineer for a remote contractor role focused on AI training data quality. You will design and execute tests to validate AI outputs, annotate datasets to improve model training, and evaluate predictions for errors and patterns.

Collaboration with cross-functional teams will shape project requirements and testing strategies. Ideal candidates have hands-on QA experience, data labeling or RLHF exposure, and English at B2 level or higher to report findings clearly.