Gen AI Consultant

Wipro; Hyderabad; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Wipro is seeking a GenAI Testing professional to validate LLMs, RAG applications, and AI-powered business solutions. You will drive QA ensuring accuracy, reliability, and security of AI-generated outcomes, and collaborate with multidisciplinary teams to define KPIs and QA best practices.

The role focuses on designing test strategies for GenAI, implementing automated validation for LLM outputs, and validating compliance and guardrails across AI systems. 6–10 years of experience preferred.

Qualifications

• GenAI testing concepts and best practices.
• Experience validating LLMs, RAG apps, and AI-based solutions.
• Familiarity with prompt engineering and evaluation.
• Ability to design AI-focused test strategies and automation.
• Experience with API testing and Python-based automation.

Responsibilities

• Design and execute test strategies for GenAI, RAG, Copilot, and Agentic AI applications.
• Validate AI responses for accuracy, relevance, bias, toxicity and hallucinations.
• Develop AI-specific test scenarios, prompt libraries, and evaluation frameworks.
• Create automated validation approaches for LLM outputs.
• Perform prompt engineering and optimization activities.
• Test RAG workflows and knowledge-grounding mechanisms.
• Validate AI guardrails and security controls.
• Collaborate with Product Owners, Data Scientists, and AI Architects.
• Define KPIs and quality metrics for AI solution evaluation.
• Support GenAI adoption and QA best practices.

Skills

GenAI Testing Concepts

LLM Validation & Evaluation

Prompt Engineering

RAG Testing

Functional Testing

Automation Testing

API Testing

Python

AI Model Evaluation Techniques

Jira

Azure DevOps

Agile Delivery Model

Tools

Jira

Azure DevOps

Job description

Job Description

Role Purpose

The purpose of this role is to develop multi-module test cases and set up test environments while preparing test evidence and validating system functionality.

Experience: 6-10 Years

Role Summary

We are seeking a GenAI Testing professional with experience in validating Large Language Models (LLMs), Agentic AI systems, RAG applications, and AI-powered business solutions. The candidate will drive quality assurance for GenAI implementations, ensuring accuracy, reliability, security, and business alignment of AI-generated outcomes.

Key Responsibilities

• Design and execute test strategies for GenAI, RAG, Copilot, and Agentic AI applications.
• Validate AI responses for accuracy, relevance, consistency, bias, toxicity, and hallucinations.
• Develop AI-specific test scenarios, prompt libraries, and evaluation frameworks.
• Create automated validation approaches for LLM outputs.
• Perform prompt engineering and prompt optimization activities.
• Test Retrieval-Augmented Generation (RAG) workflows and knowledge-grounding mechanisms.
• Validate AI guardrails, compliance requirements, and security controls.
• Collaborate with Product Owners, Business SMEs, Data Scientists, and AI Architects.
• Define KPIs and quality metrics for AI solution evaluation.
• Support GenAI adoption initiatives and recommend QA best practices.

Mandatory Skills

• GenAI Testing Concepts
• LLM Validation & Evaluation
• Prompt Engineering
• RAG Testing
• Functional & Automation Testing
• API Testing
• Python
• AI Model Evaluation Techniques
• Jira / Azure DevOps
• Agile Delivery Model

Mandatory Skills: Gen AI Automation Testing

Experience: 3-5 Years

Good to Have

• Azure OpenAI / OpenAI
• LangChain / LangGraph
• MCP (Model Context Protocol)
• Agentic AI Platforms
• GitHub Copilot
• AI Security Testing
• Python-based Automation Frameworks

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.