Agentic QA Lead

Astrello; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

Astrello is seeking an Agentic QA Team Lead to build and lead our AI-driven quality assurance program. You will manage a small QA team, assign work, coordinate day-to-day testing, and mentor staff while piloting agentic testing tools.

This is not traditional coding; day-to-day test execution is increasingly performed by AI agents. You will partner with Product, Engineering, and Architecture to demonstrate value and drive adoption.

Qualifications

• Leads a QA team and coordinates day‑to‑day testing.
• Experience mentoring QA staff and guiding test strategy.
• Familiar with AI-driven testing concepts and tools.

Responsibilities

• Assign and prioritize the QA team’s day‑to‑day testing and program work across members.
• Mentor and coach QA staff, guiding traditional and agentic testing practices.
• Pilot and configure agentic AI testing tools and report results to leadership.
• Build relationships with Product, Engineering and Architecture to demonstrate value and drive adoption.
• Define and implement the operating model for AI‑driven testing and supervise results.

Skills

Agentic AI testing

Team leadership

Mentoring

Stakeholder collaboration

Job description

The Agentic QA Team Lead is the hands-on builder and day‑to‑day leader of our agentic (AI-driven) quality assurance program. This person leads a small QA team — assigning and prioritizing work, coordinating day‑to‑day testing, and mentoring team members — while also piloting and configuring agentic AI testing tools and helping Product, Engineering, and Architecture see firsthand what AI-driven testing makes possible. This is not a hands‑on coding role in the traditional sense — deep production coding across a full tech stack is not required, since day‑to‑day test execution is increasingly performed by AI agents rather than hand‑written scripts.

Summary

The Agentic QA Team Lead is the hands‑on builder and day‑to‑day leader of our agentic (AI-driven) quality assurance program. This person leads a small QA team — assigning and prioritizing work, coordinating day‑to‑day testing, and mentoring team members — while also piloting and configuring agentic AI testing tools and helping Product, Engineering, and Architecture see firsthand what AI-driven testing makes possible. This is not a hands‑on coding role in the traditional sense — deep production coding across a full tech stack is not required, since day‑to‑day test execution is increasingly performed by AI agents rather than hand‑written scripts.

Essential Duties and Responsibilities

• Assign and prioritize the QA team's day‑to‑day testing and program work, and coordinate schedules and workload across team members.
• Mentor and coach QA team members, providing technical guidance on both traditional and agentic testing practices; provide input on onboarding for new team members.
• Build and continuously pilot the hands‑on foundation of our agentic AI QA program, in partnership with engineering leadership who own overall strategy and sponsorship.
• Build direct working relationships with Product, Engineering, and Architecture teams to demonstrate value and drive grassroots adoption; surface blockers that need executive attention to engineering leadership.
• Evaluate, pilot, and configure agentic AI testing tools and platforms; run structured proof‑of‑concept programs and report results and recommendations to leadership.
• Help define and implement the operating model for AI‑driven testing: how agents are configured and supervised, how their results are validated, escalation paths, and the boundary between what AI agents can test unsupervised versus what still requires human judgment.
• Partner with Architecture to ensure systems, APIs, test environments, and data access are structured to support effective agentic testing.
• Partner with Product to align acceptance criteria and definition of done with agentic testing capabilities.
• Support adoption through hands‑on training, live demos, and direct assistance — helping teams see and trust what agentic testing can do, and addressing skepticism with real working examples.
• Help define quality metrics appropriate to an AI‑assisted QA program (e.g., agent test coverage, agent accuracy / false‑positive rate, human‑review overhead, defect escape rate, release cycle time) and report on them to leadership.
• Share learnings with existing QA staff on working alongside and orchestrating AI testing agents rather than relying solely on traditional manual or scripted automation.
• Own the QA team's day‑to‑day testing sign‑off and contribute release‑readiness recommendations as testing execution shifts to AI agents; final go/no‑go authority for company‑wide releases remains with engineering leadership.
• Stay current on the agentic AI/QA vendor and open‑source landscape; bring new tools and approaches back to the team.
• Partner with security/compliance stakeholders to ensure AI‑driven testing tools and any AI‑generated test data meet the organization's data‑handling requirements, including HIPAA, confidentiality, and privacy obligations where applicable.
• Handle stakeholder and customer concerns in a helpful and objective manner.
• Assist in maintaining a work area that is organized and clean.
• Other duties may be assigned by your Supervisor and Managers.

Supervisory Responsibilities

This role leads a small QA team: assigning and prioritizing work, coordinating day‑to‑day testing, and mentoring and coaching team members. It does not currently include formal hiring, compensation, or performance‑review authority, which remain with engineering leadership — this is a Team Lead scope, not a full people‑manager scope. It drives adoption of agentic QA practices with Product, Engineering, and Architecture teams through relationship‑building and hands‑on demonstration, not formal authority over those teams. As the agentic QA program matures, there is a clear path for this role to grow into a fuller management scope.

Competencies

To perform the job successfully, an individual should demonstrate the following competencies:

• Hands‑on experience with, or active research/experimentation in, agentic AI testing tools, AI‑driven test generation, or autonomous test agents — this is the single most important qualification for this role.
• Some experience mentoring, coordinating, or informally leading other QA staff — comfortable assigning and prioritizing work for others, even without formal management title or tenure.
• Genuine enthusiasm for building a new practice from the ground up, including comfort operating in an ambiguous, fast‑evolving space where best practices are still forming.
• Solid understanding of the software development lifecycle and modern QA/testing methodology, sufficient to work credibly alongside engineering and architecture; deep coding proficiency in any specific language is not required.
• Strong communication skills and a knack for building trust and momentum with people who don't report to you — this role earns adoption through demonstration, not authority.
• Solid analytical skills; ability to help define and explain quality metrics for an AI‑assisted testing environment.
• Attention to detail and a strong quality mindset, even as testing execution shifts to AI agents.
• Ability to manage multiple initiatives and priorities effectively.
• Consistently at work and on time.
• Safety and security — uses equipment and materials properly.