AI Quality Engineer | Contractual | Hyderabad

Side; Hyderabad; On-site; INR 502,000 - 837,000; Part time

Job summary

Side is seeking a contractual AI QA tester in Hyderabad to validate AI-generated insights, workflows, and decision-making processes. The role focuses on evaluating LLMs and RAG systems for accuracy, relevance, and factual grounding, plus regression testing across models and prompts.

The position requires 2–3+ years in LLM/RAG testing, hands-on experience with GPT/Claude/Gemini/Llama, and strong analytical skills. Initial 3-month term with potential extension based on performance.

Qualifications

• 2 to 3+ years hands-on experience testing LLM and RAG-based applications.
• Hands-on LLM testing with GPT, Claude, Gemini, Llama.
• Experience testing at least one RAG-based application.
• Hallucination, relevance, groundedness and response quality validation.
• Strong analytical and problem-solving skills.

Responsibilities

• Test and validate AI-generated insights, recommendations, and decision-making workflows.
• Evaluate LLM and RAG systems for accuracy, relevance, consistency, factuality, and hallucinations.
• Validate retrieval quality, context relevance, grounding, and response quality in RAG systems.
• Test AI agents and autonomous workflows across functional, negative, and edge-case scenarios.
• Define AI evaluation criteria, test datasets, quality metrics, and validation processes.
• Perform regression testing for models, prompts, RAG configurations, and AI workflows.
• Collaborate with AI/ML engineers to identify issues and improve AI system quality

Skills

AI/ML testing

LLM testing

RAG testing

Analytical thinking

Problem solving

Experience with LLM & RAG

Tools

GPT

Claude

Gemini

Llama

Job description

Role Details

Contractual Role - 3 months (will be extended depending on performance and project requirement)

Location - Hyderabad (Nanakramguda)

Key Responsibilities

• Test and validate AI-generated insights, recommendations, and decision-making workflows.
• Evaluate LLM and RAG systems for accuracy, relevance, consistency, factuality, and hallucinations.
• Validate retrieval quality, context relevance, grounding, and response quality in RAG systems.
• Test AI agents and autonomous workflows across functional, negative, and edge-case scenarios.
• Define AI evaluation criteria, test datasets, quality metrics, and validation processes.
• Perform regression testing for models, prompts, RAG configurations, and AI workflows.
• Collaborate with AI/ML engineers to identify issues and improve AI system quality

Required Skills

• Strong understanding of AI/ML and Generative AI testing.
• 2 to 3+ years hands-on experience testing LLM and RAG-based applications.
• Hands-on LLM testing (GPT, Claude, Gemini, Llama)
• Experience testing at least one RAG-based application
• Hallucination, relevance, groundedness and response quality validation
• Strong analytical and problem-solving skills.