AI Quality Architect & Test Automation Leader

Cisco Systems, Inc.; San Jose (CA); On-site; USD 187,000 - 268,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with Cisco matching

Paid parental leave

Disability coverage

Job summary

Cisco Systems, Inc. seeks a visionary Technical Leader to architect the roadmap for AI-agentic QA and SOC reliability. You will mentor engineers, drive benchmarking, and define scalable testing ecosystems across AI agents and complex system workflows.

You will lead architectural reviews, guide teams through hypothesis validation, and govern POCs with rigorous experimentation to ensure enterprise-grade quality and security compliance.

Qualifications

• Bachelor’s degree plus 10+ years of software development and test automation experience, including architecting large-scale testing ecosystems.
• Proficiency in Python and Go, with ability to design scalable, high-performance testing infrastructure.
• Experience with security compliance frameworks.
• Experience with modern performance testing methodologies.
• Experience using AI to build automation and AI-driven testing.

Responsibilities

• Architectural leadership: define and oversee the architectural roadmap for QA foundations and evaluation frameworks for AI agents and workflows.
• Strategic innovation: develop AI-based testing solutions to mitigate risk and improve system integrity.
• Technical mentorship: guide teams through architectural reviews and validation of complex hypotheses.
• Experimental governance: manage POCs with rigorous experimentation standards.
• Quality ecosystem management: ensure testing delivers reliable outcomes at scale in line with enterprise standards.
• Advanced validation: establish standards for validation techniques including LLM-as-judge and isolation probes.
• Cross-functional collaboration: work with engineering leadership on contract testing, audit logs, and security compliance.

Skills

Python

Go

Test automation

Large-scale testing

Security compliance

Performance testing

AI in testing

Education

Bachelor’s degree

Tools

Playwright

JMeter

K6

Terra VM

Job description

Cisco Systems, Inc. seeks a visionary Technical Leader to architect the roadmap for AI-agentic QA and SOC reliability. You will mentor engineers, drive benchmarking, and define scalable testing ecosystems across AI agents and complex system workflows.

You will lead architectural reviews, guide teams through hypothesis validation, and govern POCs with rigorous experimentation to ensure enterprise-grade quality and security compliance.