Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.
Get past ATS filters
Benefits offered by this job
Flexible schedule
Competitive pay up to $47/hour
Gain valuable experience in AI
Job summary
A forward-thinking tech company is seeking an Evaluation Scenario Writer - QA. This part-time, project-based role invites individuals with a strong QA background to contribute to enhancing AI evaluation scenarios. Candidates will review and validate test scenarios, evaluate logic, and collaborate with tech teams. This position offers competitive pay rates with flexible scheduling and remote work options.
Qualifications
Strong QA background, preferably in complex testing environments.
Understanding of test design, regression testing, and edge case detection.
Ability to evaluate logic and structure of test scenarios.
Experience reviewing and debugging structured test case formats (JSON, YAML).
Familiarity with Python and JS scripting for test automation.
Responsibilities
Reviewing and validating test scenarios from Evaluation Writers.
Spotting logical inconsistencies, ambiguities, or missing checks.
Suggesting improvements to structure, edge cases, or scoring logic.
Collaborating with developers to automate parts of the review.
Creating clean and testable examples for others to follow.
Skills
Strong QA background
Understanding of test design
Ability to evaluate logic
Experience reviewing structured test cases
Familiarity with Python and JS
Clear communication skills
Job description
A forward-thinking tech company is seeking an Evaluation Scenario Writer - QA. This part-time, project-based role invites individuals with a strong QA background to contribute to enhancing AI evaluation scenarios. Candidates will review and validate test scenarios, evaluate logic, and collaborate with tech teams. This position offers competitive pay rates with flexible scheduling and remote work options.