Senior QA Engineer — AI-Driven Testing & Benchmarking

Cisco Systems, Inc.; New York (NY); Presencial; USD 168.000 - 282.000; Jornada completa

Descripción de la vacante

Cisco Systems, Inc. (Splunk at Cisco) seeks a Quality Engineer to drive AI-powered benchmarking and robust testing infrastructure within the Enterprise Security Apps organization.

You will translate complex quality challenges into scalable technical solutions and collaborate to improve reliability across Cisco's security ecosystems. You will implement evaluation strategies, develop testing capabilities for AI agents, and participate in design reviews to validate hypotheses and ensure security,

Formación

• Bachelor's degree or higher; 8+ years in software development and test automation preferred.
• Proven experience with Python and Groovy for scalable, high-performance testing.
• Experience with security compliance frameworks and modern performance testing methodologies.
• Experience using AI to build automation and test automation systems.

Responsabilidades

• Translate quality challenges into technical solutions and scalable testing approaches.
• Design benchmarking protocols and scalable testing infrastructure for AI agents and workflows.
• Participate in reviews and support collaboration to validate technical hypotheses.
• Lifecycle management of PoCs with standards for experimentation and validation of testing paradigms.
• Execute advanced validation techniques including LLM-based judging and tenant isolation checks.

Conocimientos

Python

Groovy

AI automation

Security compliance

Performance testing

Testing at scale

Educación

Bachelor's degree or higher

Herramientas

Playwright

OCSF

vacuum linter

Caldera

tenant isolation probes

audit log validation

LangChain

LangSmith

Claude

Codex

Descripción del empleo

Cisco Systems, Inc. (Splunk at Cisco) seeks a Quality Engineer to drive AI-powered benchmarking and robust testing infrastructure within the Enterprise Security Apps organization.

You will translate complex quality challenges into scalable technical solutions and collaborate to improve reliability across Cisco's security ecosystems. You will implement evaluation strategies, develop testing capabilities for AI agents, and participate in design reviews to validate hypotheses and ensure security,