Remote QA Engineer — AI Training & Evaluation

Xperteez Technology Pvt Ltd; United States; Remote; USD 34,000 - 69,000; Part time

Job summary

Xperteez Technology Pvt Ltd is seeking a QA Engineer contractor to contribute to high-volume AI data evaluation. You will design test cases, assess AI outputs, and document defects with precise steps for rapid resolutions.

This remote role emphasizes human data annotations and RLHF-related evaluation, with flexible start times and fast onboarding. Applicants should bring strong QA fundamentals, experience across manual and automated testing, and familiarity with toolchains like Selenium,

Qualifications

• Proven experience as a QA Engineer, SDET, QA Analyst, or similar role in software QA.
• Strong QA fundamentals: test design, bug tracking, regression testing, and both manual/automated testing.
• Hands-on with automation frameworks and test management tools such as Selenium, Playwright, Cypress, Appium, Postman, Jira, TestRail, Zephyr, or BrowserStack.
• Prior paid human data experience supporting AI training—annotation, labeling, RLHF, or rubric-based grading is required.
• Excellent analytical skills and clear written English communication (B2 level or above).
• No formal degree required; practical testing experience matters.

Responsibilities

• Evaluate and rate AI-generated outputs against quality criteria and rubrics.
• Design and assess test cases for functional, regression, and edge cases.
• Review bug reports and test docs for reproducibility and proper severity.
• Document defects with precise reproduction steps and tracking.
• Provide actionable written feedback to help developers resolve issues quickly.
• Collaborate to refine evaluation guidelines and improve testing standards.

Skills

Quality Assurance

Software Testing

Test Case Design

Automation Testing

Regression Testing

Bug Tracking

Test Management Tools

Selenium

Manual & Automated Testing

Bug Reporting

Quality Evaluation

Human Data

Tools

Selenium

Playwright

Cypress

Appium

Postman

Jira

TestRail

Zephyr

BrowserStack

Job description

Xperteez Technology Pvt Ltd is seeking a QA Engineer contractor to contribute to high-volume AI data evaluation. You will design test cases, assess AI outputs, and document defects with precise steps for rapid resolutions.

This remote role emphasizes human data annotations and RLHF-related evaluation, with flexible start times and fast onboarding. Applicants should bring strong QA fundamentals, experience across manual and automated testing, and familiarity with toolchains like Selenium,