QA engineer (manual) in AI systems

Recruitment Room - Global; United States; Remote; USD 87.000 - 165.000; Vollzeit

Zusammenfassung

Recruitment Room - Global is seeking detail-oriented QA Engineers to support the testing and evaluation of AI systems. You will apply software quality assurance expertise to validate AI outputs, assess data quality, identify defects, and provide structured feedback to improve model performance.

The role combines test case design, test execution, defect reporting, data annotation, and AI model evaluation. You will document findings clearly and collaborate with cross-functional teams to refine

Qualifikationen

• Hands-on QA experience in software testing.
• Ability to design and execute test cases.
• Strong written communication and documentation skills.
• Experience with data annotation or dataset quality review is a plus.

Aufgaben

• Design, execute, and document test cases to evaluate AI outputs.
• Review, annotate, and label datasets for model training.
• Evaluate model predictions and identify defects and patterns.
• Document results and collaborate with teams to improve processes.

Kenntnisse

QA Testing

Test planning

Defect reporting

Data labeling

Jobbeschreibung

Описание:

We are seeking detail-oriented QA Engineers to support the testing and evaluation of AI systems. You will apply software quality assurance expertise to validate AI outputs, assess data quality, identify defects, and provide structured feedback to improve model performance. The role combines test case design, test execution, defect reporting, data annotation, and AI model evaluation. It is suited to professionals who can assess results systematically, document findings accurately, and communicate quality issues clearly.

Задачи:

Design, execute, and document test cases and scenarios to evaluate AI outputs against defined requirements. Review, annotate, and label datasets to support accurate machine learning model training. Evaluate model predictions and identify inconsistencies, defects, errors, and recurring patterns. Document test results, evaluation findings, and feedback in clear, organized records. Collaborate with cross-functional teams to clarify requirements, communicate findings, and resolve questions. Contribute to the development and refinement of testing methodologies for AI-driven systems. Recommend improvements to data quality, testing processes, and model performance.

Требования:

Hands-on experience in software quality assurance and testing. Understanding of test planning, test case design, test execution, and defect reporting. Strong attention to detail when reviewing outputs, datasets, and test results. Ability to analyze findings, identify inconsistencies, and provide actionable feedback. Proficiency in English at B2 level or above. Strong written communication and documentation skills. Ability to collaborate effectively with cross-functional teams. Будет плюсом: Experience with data labeling, data annotation, or dataset quality review; Familiarity with AI model evaluation or reinforcement learning from human feedback (RLHF); Experience evaluating system outputs against defined quality standards; Ability to identify patterns in test results and recommend improvements to testing methodologies

Условия:

Job Type: Contract Work Arrangement: Remote The hourly rate is $63–$120, equivalent to approximately $120,960–$230,400 per year at 1,920 working hours annually. This annualized figure is for comparison only; actual earnings depend on contracted hours and workload.