Remote QA Automation Engineer for AI Training & Evaluation

Synthires; San Francisco (CA); Remote; USD 83,000 - 154,000; Part time

Benefits offered by this job

Fully remote

Job summary

Synthires is seeking experienced QA Engineers, SDETs, and Test Engineers to contribute to AI training and evaluation projects. You will design and execute comprehensive test plans, perform manual and automated testing, and provide detailed feedback to improve AI-driven outputs.

Responsibilities include developing realistic testing scenarios, tracking defects, and collaborating with engineering teams to refine testing methodologies and quality standards.

Qualifications

• Proven professional experience as a QA Engineer, SDET, or similar role.
• Strong understanding of software testing and QA principles.
• Hands-on experience with test case design, regression testing, manual testing, automated testing, and bug tracking.
• Experience using bug tracking and test management tools.
• Strong analytical and problem-solving skills.
• Excellent written and verbal communication skills.
• Ability to identify subtle defects and provide actionable technical feedback.
• Ability to follow testing and evaluation guidelines.

Responsibilities

• Design and execute functional, regression, integration, and edge-case test scenarios.
• Perform manual and automated testing and document results with clear, reproducible steps.
• Identify, reproduce, document, and track software bugs and defects.
• Evaluate AI-generated outputs against defined quality standards and rubrics.
• Provide written feedback, annotations, and technical assessments to improve output quality.
• Develop realistic QA and software testing scenarios based on real-world engineering workflows.
• Assess test results for accuracy, reliability, completeness, and consistency.
• Collaborate with project teams to refine testing methodologies, evaluation guidelines, and quality standards.
• Maintain a high standard of technical accuracy, documentation, and attention to detail.

Skills

QA Engineer

SDET

Test Engineer

Software Testing

Quality Assurance

Test Case Design

Regression Testing

Automation Testing

Manual Testing

Bug Tracking

Documentation

Tools

Bug Tracking Tools

Job description

Synthires is seeking experienced QA Engineers, SDETs, and Test Engineers to contribute to AI training and evaluation projects. You will design and execute comprehensive test plans, perform manual and automated testing, and provide detailed feedback to improve AI-driven outputs.

Responsibilities include developing realistic testing scenarios, tracking defects, and collaborating with engineering teams to refine testing methodologies and quality standards.