Senior QA Engineer, AI/ML Testing & Security

Cisco Systems, Inc; San Jose (CA); On-site; USD 168,000 - 245,000; Full time

Benefits offered by this job

10 paid holidays per year plus floatin

Paid vacation and sick time

Comprehensive medical/dental/vision

Job summary

Cisco Systems, Inc. is seeking a Quality Engineer to build and scale AI-powered testing infrastructure for Cisco's security ecosystem. You will translate complex quality challenges into robust solutions, collaborating across teams to implement benchmarking and validation across AI agents and workflows.

The role emphasizes performance testing, security compliance, and automation using AI techniques. The position requires 8+ years in software development and test automation, with deep

Qualifications

• Bachelor's degree with 8+ years in software development and test automation, including large-scale testing ecosystems.
• Strong Python and Groovy programming for scalable, high-performance tests.
• Experience with security compliance frameworks and modern performance testing.
• Proven ability to use AI to build test automation and QA tools.

Responsibilities

• Translate quality challenges into technical solutions and boost engineering efficiency through evaluation strategies.
• Design scalable testing infrastructure and benchmarking protocols for AI agents and systems.
• Collaborate in code/design reviews and validate testing hypotheses across teams.
• Implement PoCs and ensure adherence to experimentation standards and validation paradigms.
• Execute advanced validation techniques including LLM-based judging and tenant isolation probes.

Skills

Python

Groovy

Testing frameworks

AI/ML testing

Security compliance

Performance testing

Education

Bachelor's degree

Tools

Playwright

OCSF

Caldera

LangChain

Job description

Cisco Systems, Inc. is seeking a Quality Engineer to build and scale AI-powered testing infrastructure for Cisco's security ecosystem. You will translate complex quality challenges into robust solutions, collaborating across teams to implement benchmarking and validation across AI agents and workflows.

The role emphasizes performance testing, security compliance, and automation using AI techniques. The position requires 8+ years in software development and test automation, with deep