Lead QA Architect for Generative AI Platforms

Jobtailor; Milpitas (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Jobtailor is seeking a senior QA leader to own the quality strategy for large-scale Generative AI products. You will define validation approaches for AI services, distributed systems, and end-to-end customer experiences.

You will design scalable testing across AI pipelines, APIs, UIs, and multi-tenant SaaS, and establish release-readiness using quality gates and data-driven Go/No-Go criteria. Mentorship and cross-team collaboration are essential.

Qualifications

• Design and implement test strategies, automation frameworks, and test infrastructure for distributed software systems, cloud platforms, or SaaS products.
• Strong Python development experience and familiarity with automated testing tools such as Pytest, Playwright, or Selenium.
• Experience validating REST and GraphQL APIs, CI/CD pipelines, and distributed microservice architectures.
• Ability to define release-quality criteria and conduct root-cause analysis from logs and metrics.
• Preferred: experience testing Generative AI, AI/ML platforms, or AI agents; experience AI-agent-assisted QA workflows.

Responsibilities

• Lead the quality strategy for large-scale Generative AI products and platforms.
• Define validation approaches for AI services, distributed systems, and end-to-end customer experiences.
• Design scalable testing and automation across AI pipelines, APIs, UI, microservices, and multi-tenant SaaS.
• Establish release-readiness practices using quality gates and data-driven Go/No-Go criteria.
• Analyze model degradation, system failures, and test instability; drive root-cause analysis.
• Partner with Engineering, Product, UX, DevOps, Documentation, and Customer Engineering.
• Mentor QA engineers and advance quality-first practices across teams.

Skills

Python Development

Automated Testing Frameworks

Test Strategy Design

Distributed Systems Testing

Root-Cause Analysis

Collaboration

Leadership

Quality Gates Definition

Data-Driven Go/No-Go Criteria

Education

BS in Computer Science or Engineering with 12+ years

MS in Computer Science or related field with 8+ years

PhD with 5+ years

Tools

Pytest

Playwright

Selenium

Kubernetes

ArgoCD

Cursor

Claude

Codex CLI

Job description

Jobtailor is seeking a senior QA leader to own the quality strategy for large-scale Generative AI products. You will define validation approaches for AI services, distributed systems, and end-to-end customer experiences.

You will design scalable testing across AI pipelines, APIs, UIs, and multi-tenant SaaS, and establish release-readiness using quality gates and data-driven Go/No-Go criteria. Mentorship and cross-team collaboration are essential.