QA Engineer

SaidGig; New York (NY); À distance; USD 124 000 - 241 000; Plein temps

Résumé du poste

SaidGig is seeking a QA-focused professional to evaluate AI outputs and help improve how AI systems learn, reason, and perform on a remote contract basis. The role emphasizes high-volume, rigorous testing and requires prior paid human-in-the-loop evaluation experience.

You will design tests, score outputs against criteria, and provide precise, actionable feedback to developers. Strong English communication and reliable internet access are essential to begin promptly.

Qualifications

• Professional QA Engineer, SDET, Test Engineer, or QA Analyst experience.
• Strong QA, testing, test case design, bug tracking, regression testing, and manual/automated testing strategies.
• Hands-on automation framework experience with Selenium, Playwright, Cypress, Appium, Postman, Jira, TestRail, Zephyr, BrowserStack.
• Prior paid experience supporting AI training through human data annotation, labeling, RLHF, AI response or model evaluation, or rubric-based grading.
• Excellent written English communication at B2 level or above.
• No formal degree required.
• Demonstrable practical testing experience is prioritized.
• Reliable internet access and readiness to begin promptly.

Responsabilités

• Evaluate and score AI outputs against quality rubrics.
• Design functional, regression, edge-case, negative, and boundary test cases.
• Review bug reports for reproducibility and severity.
• Document defects with precise reproduction steps.
• Provide actionable feedback to developers.
• Collaborate with project teams to refine evaluation guidelines and testing methods.

Connaissances

QA Engineer

SDET

Test Engineer

QA Analyst

Formation

No formal degree required

Outils

Selenium

Playwright

Cypress

Appium

Postman

Jira

TestRail

Zephyr

BrowserStack

Description du poste

Role Overview

Apply software quality assurance expertise to evaluate technical AI outputs and help improve how next-generation AI systems learn, reason, and perform. This remote contract opportunity supports a high-volume project and does not require prior AI experience, but it does require prior paid human-in-the-loop AI evaluation work.

Key Responsibilities

• Evaluate and score AI-generated technical outputs against established quality criteria and rubrics, identifying responses that appear correct but are inaccurate or incomplete.
• Design and assess thorough functional, regression, edge-case, negative, and boundary test cases.
• Review bug reports and test documentation for reproducibility, completeness, and appropriate severity assessment.
• Identify, isolate, and document defects with precise reproduction steps using structured tracking methods.
• Provide detailed written feedback and annotations that developers can act on without further clarification.
• Work with project teams to refine evaluation guidelines and continuously improve testing standards and methods.

Qualifications

• Professional experience as a QA Engineer, SDET, Test Engineer, QA Analyst, or in a comparable software quality assurance role.
• Strong knowledge of quality assurance, software testing, test case design, bug tracking, regression testing, and manual and automated testing strategies.
• Hands-on experience with automation frameworks and test management tools, such as Selenium, Playwright, Cypress, Appium, Postman, Jira, TestRail, Zephyr, BrowserStack, or similar tools.
• Prior paid experience supporting AI training through human data annotation, labeling, RLHF, AI response or model evaluation, or rubric-based grading. Software QA experience alone does not meet this project requirement.
• Excellent analytical and problem-solving skills, close attention to detail, and the ability to communicate complex findings clearly in written English at B2 level or above.
• No formal degree is required.
• Demonstrable practical testing experience is prioritized.
• Reliable internet access and readiness to begin promptly.

Work Terms

Remote contract engagement.

Compensation

$90 to $175 per hour.