Test Lead - AI Agent Testing

Hexaware Technologies; Pune District, Chennai, Bengaluru; Híbrido; INR 1.500.000 - 2.100.000; Jornada completa

Descripción de la vacante

Hexaware Technologies Limited is seeking a Senior AI QA Engineer in Bengaluru with hybrid work setup. The role focuses on ensuring quality, reliability, performance, and security for enterprise-grade AI applications, including web apps, APIs, and AI-powered solutions built with LLMs and agent frameworks.

You will collaborate with AI Developers, Architects, Product Managers, and DevOps to establish quality practices across the AI application lifecycle and validate end-to-end workflows, AI agents,

Formación

• Experience: 5-8 years in QA for AI-enabled apps and web platforms.
• Strong testing for AI-powered solutions, APIs, and cloud-native systems.
• Familiarity with LLMs, agent frameworks, RAG architectures and vector databases.

Responsabilidades

• Validate React.js frontend applications.
• Test backend services built with Python and Node.js.
• Perform Functional, Integration, Regression, System, and UAT testing.
• Validate REST APIs and microservices.
• Ensure end-to-end business workflow validation.
• Test AI agents built using LangGraph and LangChain.
• Validate agent orchestration and decision paths.
• Verify tool calling, MCP integrations, and agent-to-agent communication.
• Create test scenarios for multi-agent systems.
• Validate prompt templates and prompt execution behavior.
• Test document ingestion pipelines and embedding generation.
• Verify vector DB indexing and retrieval quality.
• Validate semantic search accuracy and retrieval relevance.
• Test grounding quality and hallucination prevention.
• Test Neo4j graph ingestion pipelines and graph traversal.

Conocimientos

5-8 years experience

Herramientas

React.js

Python

Node.js

LangGraph

LangChain

Neo4j

LLM integrations

Descripción del empleo

Role & responsibilities

Experience: 5-8 YearsLocation: Bengaluru / HybridEmployment Type: Full-TimeAbout the RoleWe are seeking an experienced and highly motivated Senior AI QA Engineer to ensure the quality, reliability, performance, security, and accuracy of enterprise-grade AI applications.The ideal candidate will have strong experience testing modern web applications, APIs, cloud-native systems, and AI-powered solutions built using LLMs, Agentic AI frameworks, RAG architectures, Vector Databases, and Knowledge Graphs.You will work closely with AI Developers, Architects, Product Managers, and DevOps teams to establish quality engineering practices across the entire AI application lifecycle.

Key Responsibilities

• Application TestingValidate React.js frontend applications.
• Test backend services built using Python and Node.js.
• Perform Functional, Integration, Regression, System, and User Acceptance Testing.
• Validate REST APIs and microservices.
• Ensure end-to-end business workflow validation.
• AI & Agent TestingTest AI agents built using LangGraph and LangChain.
• Validate agent orchestration workflows and decision-making paths.
• Verify tool calling, MCP integrations, and agent-to-agent communication.
• Build test scenarios for multi-agent systems.
• Validate prompt templates and prompt execution behavior.
• RAG & Search ValidationValidate document ingestion pipelines.
• Test chunking strategies and embedding generation.
• Verify vector database indexing and retrieval quality.
• Validate semantic search accuracy.
• Measure retrieval precision and relevance scores.
• Test grounding quality and hallucination prevention.
• Knowledge Graph TestingTest Neo4j graph ingestion pipelines.
• Validate node and relationship creation.
• Verify graph traversal accuracy.
• Test graph-based reasoning workflows.
• LLM TestingValidate GPT, Claude, Gemini, Llama, and other model integrations.
• Create AI evaluation datasets.
• Test response consistency and reliability.
• Validate hallucination rates.
• Measure factual c