AI-Powered Test Automation Engineer for Scalable QA

020 Cisco Systems, Inc.; San Jose (CA); On-site; USD 168,000 - 245,000; Full time

Job summary

Cisco Systems, Inc. in San Jose seeks a software engineer to build test infrastructure for AI-powered SOC. You will translate quality challenges into scalable testing solutions and drive benchmarking and validation of hypotheses with peers.

The role emphasizes Python and Go, large-scale testing ecosystems, and security/compliance, with opportunities to influence the development lifecycle through contract testing and audit log validation.

Qualifications

• Bachelor's degree plus 8+ years of software development and test automation experience.
• Strong programming in Python and Go with scalable testing infrastructure skills.
• Experience with security compliance frameworks and modern performance testing.
• Experience using AI to build automation and testing solutions.

Responsibilities

• Contribute to PQ foundations and evaluation frameworks for AI agents and systems.
• Develop AI-based testing solutions to mitigate risk and ensure integrity.
• Collaborate in code/design reviews and validate technical hypotheses.
• Implement lifecycle of proof-of-concepts with standardized experimentation.
• Ensure testing processes deliver high-quality, reliable outcomes.
• Apply validation techniques including LLM-as-judge and tenant isolation.

Skills

Python

Go

Test automation

Large-scale testing

Security compliance

AI-based automation

LangChain

LangSmith

Playwright

LLM APIs

Prompt engineering

Contract testing

Audit log validation

OCSF validation

K6

JMeter

Caldera

Tenant isolation probes

Education

Bachelor's degree in Computer Science or related field

Tools

Playwright

LangChain

LangSmith

OCSF

K6

JMeter

Caldera

LLM APIs (Claude, Codex)

Prompt engineering tools

Job description

Cisco Systems, Inc. in San Jose seeks a software engineer to build test infrastructure for AI-powered SOC. You will translate quality challenges into scalable testing solutions and drive benchmarking and validation of hypotheses with peers.

The role emphasizes Python and Go, large-scale testing ecosystems, and security/compliance, with opportunities to influence the development lifecycle through contract testing and audit log validation.