Remote AI Quality Lead

Phase2; United States; Remote; USD 120,000 - 145,000; Full time

Job summary

Phase2, a remote-first digital agency, seeks a Lead AI Quality Engineer to own QA evolution across AI-powered and legacy software. You will set standards, shape a roadmap, and guide client delivery while growing Phase2's quality practice.

You will mentor the QA team, partner with engineering leadership, and socialize our approach across departments, ensuring high-quality software delivery in an era of rapid AI-driven development.

Qualifications

• 8+ years of software QA experience, preferably with demonstrated experience testing AI/ML-powered features.
• Experience leading, mentoring, and coaching QA teams.
• Proficiency in writing automated tests in at least one framework.
• Strong communication skills with technical and non-technical stakeholders.

Responsibilities

• Set the vision and roadmap for software quality.
• Define testing standards and defaults across manual/automated testing with human oversight.
• Innovate approaches to accelerate QA testing in AI-enabled environments.
• Lead the use of agentic AI to write tests and train teams on usage.
• Recommend improvements to project execution and SDLC integration for QA.
• Socialize QA approach across the company and partner departments.
• Oversee agentic QA tooling and AI tool integration into delivery framework.
• Test Phase2-built AI tools and evaluate for improvements.
• Develop AI evaluation frameworks covering accuracy, relevance, bias.

Skills

Quality strategist

Systems thinking

AI testing mindset

Technical adaptability

Client-facing consulting

Mentor and team leadership

Tools

AI testing tools

CI/CD tooling

Test automation frameworks

Job description

Phase2, a remote-first digital agency, seeks a Lead AI Quality Engineer to own QA evolution across AI-powered and legacy software. You will set standards, shape a roadmap, and guide client delivery while growing Phase2's quality practice.

You will mentor the QA team, partner with engineering leadership, and socialize our approach across departments, ensuring high-quality software delivery in an era of rapid AI-driven development.