Senior QA Engineer - AI-Driven Testing & Benchmarking

020 Cisco Systems, Inc.; New York (NY); On-site; USD 168,000 - 282,000; Full time

Job summary

Cisco Systems, Inc. in New York City is seeking a Senior Quality Engineer to design and scale AI-powered test ecosystems for enterprise security apps. You will build robust benchmarking and testing infrastructure, and apply advanced validation techniques to ensure reliability and security across Cisco’s unified security solutions.

The role requires 8+ years in software development and test automation, with Python and Groovy expertise, and a strong background in AI-assisted testing.

Qualifications

• Bachelor’s degree plus 8+ years in software development and test automation.
• Programming in Python and Groovy for scalable testing infrastructure.
• Experience with security compliance frameworks.
• Experience implementing modern performance testing methodologies.
• Experience using AI to build test automation.

Responsibilities

• Translate quality challenges into technical solutions and drive efficiency through evaluation strategies.
• Collaborate to implement benchmarking protocols and scalable testing infrastructure.
• Support reliability, security of Cisco’s unified security ecosystems.
• Develop AI-based solutions or agents to mitigate risk and enhance testing integrity.
• Participate in code and design reviews and validate testing paradigms.
• Execute advanced validation techniques, including LLM-as-judge methodologies and tenant isolation probes.

Skills

Python

Groovy

AI automation

Security compliance

Performance testing

Education

Bachelor's degree

Tools

Playwright

OCSF

Caldera

Job description

Cisco Systems, Inc. in New York City is seeking a Senior Quality Engineer to design and scale AI-powered test ecosystems for enterprise security apps. You will build robust benchmarking and testing infrastructure, and apply advanced validation techniques to ensure reliability and security across Cisco’s unified security solutions.

The role requires 8+ years in software development and test automation, with Python and Groovy expertise, and a strong background in AI-assisted testing.