AI Quality Strategy Lead

phase2-careers; United States; Hybrid; USD 140,000 - 190,000; Full time

Job summary

Phase2 is a remote-first digital agency seeking a Lead AI Quality Engineer to shape and drive QA for AI-enabled software. You will define standards, mentor the team, and oversee agentic AI tooling while coordinating with Clients and Engineering leadership.

You will lead a two-front QA effort: testing AI-powered features and applying AI-driven techniques to legacy systems, ensuring high quality across AI-driven delivery engagements.

Qualifications

• 8+ years of software QA experience, with AI/ML feature testing.
• Ability to translate coverage decisions into business narratives for clients.
• Experience designing QA strategy and roadmaps in an agency or consulting setting.

Responsibilities

• Set and maintain the vision and roadmap for software quality.
• Define testing standards, including automation and human oversight.
• Lead AI-powered testing initiatives and agentic QA tooling.
• Integrate QA across the SDLC and CI/CD workflows.
• Coach and mentor the QA team and advocate quality with clients.
• Socialize QA approach across departments.

Skills

Quality strategist

Systems thinker

AI-native testing

Technical adaptability

Client-facing consultant

Mentor and practice builder

Tools

Automation frameworks

AI testing tools

Job description

Phase2 is a remote-first digital agency seeking a Lead AI Quality Engineer to shape and drive QA for AI-enabled software. You will define standards, mentor the team, and oversee agentic AI tooling while coordinating with Clients and Engineering leadership.

You will lead a two-front QA effort: testing AI-powered features and applying AI-driven techniques to legacy systems, ensuring high quality across AI-driven delivery engagements.