AI QA Tester

Conch Technologies Inc; Minnesota; Remote; USD 83,000 - 124,000; Part time

Benefits offered by this job

Remote work option

6+ month contract

Job summary

Conch Technologies, Inc. is seeking an AI QA Tester for a remote, 6+ month contract. You will own the quality strategy for AI-powered applications and models, defining end-to-end AI testing, and leading testing execution with modern AI tools to ensure reliable AI delivery.

The role requires 8+ years in QA/testing with 2+ years in AI/ML testing, plus hands-on testing tools experience and leadership of QA teams. Remote work options are available.

Qualifications

• 8+ years in software QA/testing.
• 2+ years hands-on testing AI/ML applications and models.
• Hands-on with AI-based testing tools and test automation.
• Ability to create and drive AI testing strategy from the ground up.
• Strong understanding of model evaluation metrics and AI failure modes.

Responsibilities

• Define how we test AI systems end-to-end.
• Lead testing execution using modern AI tools.
• Set the standard for reliable, trustworthy AI delivery.

Skills

QA/testing

AI/ML testing

Test automation

Leadership/mentoring

Model evaluation metrics

Tools

AI testing tools

CI/CD pipelines

MLOps tooling

Job description

Hi,

AI QA Tester

Remote

6+ months contract

About the Role

We are looking for an
AI Testing with
8+ years of overall testing experience, including
2+ years testing AI/ML systems, to own the quality strategy for our AI-powered applications and models. You will define how we test AI systems end-to-end, lead testing execution using modern AI tools, and set the standard for reliable, trustworthy AI delivery.

Required Skills & Experience

• 8+ years in software QA/testing, with 2+ years hands-on testing AI/ML applications and models.
• Hands-on with AI-based testing tools and test automation.
• Ability to create and drive AI testing strategy from the ground up.
• Strong understanding of model evaluation metrics and AI failure modes.
• Proven experience leading QA teams and mentoring testers.

Nice to Have

• Experience testing LLM / GenAI applications (prompt testing, RAG evaluation).
• Familiarity with CI/CD and MLOps pipelines.

With Regards,
Chanakya | Sr. Technical Recruiter
[e-mail] | [phone]
Conch Technologies, Inc | www.conchtech.com
linkedin.com/in/chanikyabhadrachalam