Technical Leader, AI-Driven Test Automation & Security

Cisco Systems, Inc.; San Jose (CA); On-site; USD 187,000 - 308,000; Full time

Job summary

Cisco Systems, Inc. is seeking a Technical Leader to architect an AI-powered SOC quality roadmap. You’ll mentor engineers, define evaluation frameworks, and drive benchmarking for scalable, high-impact testing infrastructures.

Responsibilities include leading architectural roadmaps, developing AI-based testing solutions, overseeing POC lifecycles, and ensuring security compliance across complex systems. This role emphasizes cross-functional collaboration and advanced validation strategies.

Qualifications

• Bachelor’s degree plus 10+ years of experience in software development and test automation, to include experience architecting large-scale testing ecosystems.
• Demonstrated experience in programming, to include Python and Go, with a demonstrated ability to design scalable, maintainable, and high-performance testing infrastructure.
• Demonstrated experience with security compliance frameworks.
• Demonstrated experience with modern performance testing methodologies.
• Demonstrated experience using AI to build automation (writing AI skills to build test automation)

Responsibilities

• Architectural Leadership: Define and oversee the architectural roadmap for PQ foundations and evaluation frameworks, ensuring robust assessment capabilities for AI agents, complex workflows, and underlying system processes.
• Strategic Innovation: Identify systemic gaps in testing methodologies and lead the development of AI-based solutions or agents to proactively mitigate risk and enhance system integrity.
• Technical Mentorship & Oversight: Drive the technical culture by mentoring engineering talent, conducting architectural reviews, and guiding teams through the validation of complex technical hypotheses.
• Experimental Governance: Oversee the lifecycle of proof-of-concepts (POCs), establishing rigorous standards for experimentation and the validation of novel testing paradigms.
• Quality Ecosystem Management: Ensure that testing processes consistently deliver reliable, high-quality outcomes at scale, maintaining alignment with enterprise-level quality standards.
• Advanced Validation Strategy: Set the technical standard for groundbreaking validation techniques, including LLM-as-judge methodologies, tenant isolation probes, and behavioral regression suites.
• Cross-Functional Collaboration: Partner with engineering leadership to enforce rigorous contract testing, audit log validation, and security compliance, ensuring seamless integration of quality across the development lifecycle.

Skills

Python

Go

Test automation

AI in testing

Education

Bachelor’s degree

Tools

Playwright

LangChain

LangSmith

K6

JMeter

OCSF validation libraries

Job description

Cisco Systems, Inc. is seeking a Technical Leader to architect an AI-powered SOC quality roadmap. You’ll mentor engineers, define evaluation frameworks, and drive benchmarking for scalable, high-impact testing infrastructures.

Responsibilities include leading architectural roadmaps, developing AI-based testing solutions, overseeing POC lifecycles, and ensuring security compliance across complex systems. This role emphasizes cross-functional collaboration and advanced validation strategies.