AI Senior Engineer

Kaleidoscope Innovation; Cupertino (CA); Hybrid; USD 150,000 - 190,000; Full time

Job summary

Kaleidoscope Innovation seeks a QA Engineer skilled in GenAI, LLMs and AI-driven test automation to advance intelligent QA across web experiences.

You will design AI-QE architectures, implement RAG-based test generation, and collaborate with QE, engineering, and product teams to deliver scalable AI solutions. Hybrid Sunnyvale-based role with cutting-edge AI testing initiatives.

Qualifications

• Strong experience with GenAI, LLMs, and agent AI in software quality engineering and test automation.
• Able to translate requirements, user stories, and API contracts into executable test scenarios.
• Experience designing multi-agent workflows for test generation and defect analysis.
• Develop AI-assisted mechanisms for defect identification, classification, deduplication and automation.
• Experience with multilingual validation and translation quality for content accuracy.
• Strong knowledge of WCAG 2.2 and accessibility automation checks.
• Proficiency in Python and Java/TypeScript; integrating LLMs via APIs.
• Experience building RAG pipelines with embeddings and vector databases.

Responsibilities

• Design AI-QE solution architecture and technical roadmap.
• Lead QE, engineering, product, and client discussions translating problems into scalable AI solutions.
• Implement AI-assisted validation across web experiences for accessibility and quality.
• Develop and maintain test automation frameworks and CI/CD integrations.
• Ground AI-generated tests in approved requirements using RAG pipelines.
• Mentor and collaborate with cross-functional teams.

Skills

GenAI & LLMs

Requirements to test cases

Requirements analysis

Multi-agent workflows

AI-assisted defect analysis

Multilingual validation

WCAG accessibility

Automation testing

RAG pipelines

AI-QE architecture

Python

Java/TypeScript

Stakeholder communication

Tools

Playwright

REST API automation

Vector DB

Job description

• Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.*

• Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.*

Location

Sunnyvale, CA (hybrid)

Requirements

• Strong practical experience with GenAI, LLMs and agents AI to software quality engineering and test lifecycle automation .
• Ability to convert requirements, user stories, specifications, API contracts and technical documentation into executable test scenarios and test cases.
• Experience building solutions that analyze requirements for functional gaps, ambiguity, traceability, risk and test coverage.
• Hands-on experience designing multi-agent workflows for requirement analysis, test generation, defect analysis, validation and quality intelligence.
• Capability to develop AI-assisted mechanisms for defect identification, classification, deduplication, severity assessment, root-cause analysis and automated defect filing.
• Expreience in developing AI/LLM-based validation for multilingual and localized content, including translation accuracy, formatting, connect, truncation, and content consistency.
• Strong understanding accessibility standards such as WCAG2.2 with the ability to build AI-assisted automated checks for accessibility violations across web experiences.
• Strong experience with Automation frameworks API/UI testing , CI/CD integration, test orchestration, reporting.
• Experience building RAG pipelines using embeddings and vector database to ground AI generated test scenarios and validations in approved requirements and product knowledge.
• Ability to define the AI-QE Solution architecture, technical roadmap, reusable accelerators, engineering standard, and measurable business outcomes.
• Strong hands-on expertise in Python and Java/Typescript with experience integrating LLM and AI services through APIs
• Ability to lead technical discussions with QE, engineering, product, and client stakeholders and translate business problems into scalable AI solutions.

Technology Exposure

• LLMs, RAG, Agentic AI, Prompt Engineering, Multimodal AI, AI Evaluation
• Python, Java/Typescript
• Playwright, REST API automation, CI/CD
• WCAG 2.1/2.2
• Embedding, Vector DB, Document Parsing

Kaleidoscope, an Infosys Company, is an equal opportunity employer, and all qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, spouse of protected veteran, or disability.