AI Quality Lead: End-to-End ML Testing & Validation

CirrusLabs, LLC; Seattle (WA); On-site; USD 120,000 - 190,000; Full time

Job summary

CirrusLabs, LLC is seeking an AI Test Lead to own the quality strategy for AI-powered applications and models in Seattle. The role requires 8+ years of QA/testing experience, including 2+ years testing AI/ML systems, with hands-on work using AI-based testing tools and test automation.

You will define end-to-end AI testing approaches, lead testing execution, and set the standard for trustworthy AI delivery. Collaborating with data science, engineering, and product teams, you will establish

Qualifications

• 8+ years in software QA/testing with 2+ years testing AI/ML applications and models.
• Hands-on experience with AI-based testing tools and test automation.
• Ability to create and drive AI testing strategy from the ground up.
• Strong understanding of model evaluation metrics and AI failure modes.
• Experience leading QA teams and mentoring testers.

Responsibilities

• Define and own the AI testing strategy for applications and models.
• Lead AI application testing across functional, integration, and user-facing behavior.
• Perform model testing and validation (accuracy, robustness, bias, drift, hallucination, and performance).
• Leverage AI-powered testing tools to design, automate, and accelerate test coverage.
• Establish test frameworks, quality gates, and acceptance criteria for AI features.
• Collaborate with data science, engineering, and product teams to embed quality early.
• Report on quality metrics, risks, and readiness for release.

Skills

QA Testing

AI/ML Testing

Test Automation

QA Leadership

Strategy Development

Tools

AI-based testing tools

Job description

CirrusLabs, LLC is seeking an AI Test Lead to own the quality strategy for AI-powered applications and models in Seattle. The role requires 8+ years of QA/testing experience, including 2+ years testing AI/ML systems, with hands-on work using AI-based testing tools and test automation.

You will define end-to-end AI testing approaches, lead testing execution, and set the standard for trustworthy AI delivery. Collaborating with data science, engineering, and product teams, you will establish