Lead AI QA Engineer

Kaleidoscope Innovation; Cupertino (CA); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Kaleidoscope Innovation seeks a QE/AI Engineer to apply GenAI, LLMs and agent-based AI across software quality engineering and test lifecycle automation. You will design test scenarios, cases and data from requirements, API contracts and docs.

Responsibilities include analyzing requirements for gaps, building multi-agent workflows for test generation, defect analysis and quality intelligence, and developing AI-assisted validation for multilingual content and accessibility checks.

Qualifications

• Must have hands-on experience applying GenAI/LLMs to QE and test automation.
• Ability to design test scenarios, test cases and data from requirements and API contracts.
• Experience building AI-assisted defect identification, classification and root-cause analysis.

Responsibilities

• Apply GenAI/LLMs and agents AI to software quality engineering and test lifecycle automation.
• Design/test data from requirements, user stories, specs, APIs and docs.
• Build multi-agent workflows for requirement analysis, test generation, defect analysis and quality intelligence.
• Develop AI-assisted mechanisms for defect filing, classification and remediation.

Skills

GenAI & LLMs in QE

Test scenario/test data design

AI-assisted defect analysis

Multilingual content validation

WCAG accessibility automation

API/UI testing automation

CI/CD integration

Embeddings/Vector databases/RAG

Python

Java/TypeScript

Lead technical discussions

AI-driven requirements analysis

Tools

Playwright

REST API automation

Document Parsing

Vector DB

RAG tooling

Job description

Kaleidoscope Innovation seeks a QE/AI Engineer to apply GenAI, LLMs and agent-based AI across software quality engineering and test lifecycle automation. You will design test scenarios, cases and data from requirements, API contracts and docs.

Responsibilities include analyzing requirements for gaps, building multi-agent workflows for test generation, defect analysis and quality intelligence, and developing AI-assisted validation for multilingual content and accessibility checks.