Senior AI QA Engineer

Michael Page; Hyderabad; On-site; INR 1,800,000 - 2,800,000; Full time

Benefits offered by this job

Performance bonus

Career growth

Job summary

Michael Page is seeking an experienced AI/ML QA professional to test next-generation AI agents, multi-agent workflows, and GenAI applications. The role focuses on validating RAG pipelines, reasoning accuracy, and tool-calling while building Python/PySpark-based testing frameworks.

You will assess hallucination, safety, regression, and performance risks and collaborate with Data Science and AI Engineering teams to shape quality practices at scale.

Qualifications

• 5–10 years of software, AI/ML, or testing experience.
• Strong programming skills in Python and data processing with PySpark.
• Hands-on knowledge of LLMs, RAG, LangChain, and LangGraph.
• Experience building or testing AI agent workflows and evaluation tools.
• Excellent communication and stakeholder management skills.

Responsibilities

• Test AI agents, multi-agent workflows, and GenAI applications.
• Validate RAG pipelines, reasoning accuracy, and tool-calling.
• Build Python/PySpark-based AI testing frameworks.
• Assess hallucination, safety, regression, and performance risks.
• Collaborate with Data Science and AI Engineering teams.

Skills

Python

PySpark

Automation testing

AI testing

LLMs

LangChain

LangGraph

Tools

RAG pipelines

Agent orchestration

Quality frameworks

Job description

• Work on next-generation AI agents and GenAI platforms.
• Build AI quality frameworks in a high-impact environment.

About Our Client

Our client is a leading enterprise organisation investing significantly in artificial intelligence, automation, and advanced analytics. The organisation is building scalable AI-powered products and is focused on delivering reliable, governed, and production-ready GenAI solutions across business functions.

Job Description

• Test AI agents, multi-agent workflows, and GenAI applications.
• Validate RAG pipelines, reasoning accuracy, and tool-calling.
• Build Python/PySpark-based AI testing frameworks.
• Assess hallucination, safety, regression, and performance risks.
• Collaborate with Data Science and AI Engineering teams.

The Successful Applicant

• 5-10 years of software, AI/ML, or testing experience.
• Strong expertise in Python, PySpark, and automation testing.
• Hands-on knowledge of LLMs, RAG, LangChain, and LangGraph.
• Experience with AI agents, orchestration, and evaluation tools.
• Strong communication and stakeholder management skills.

What's on Offer

• Opportunity to shape AI quality practices at scale.
• Exposure to cutting-edge GenAI and agentic technologies.
• Significant collaboration with AI Engineering teams.
• Competitive compensation with performance bonus.
• Long-term career growth in a rapidly evolving AI domain.