AI Quality Engineer (Contract)

Side; Hyderabad; On-site; INR 600,000 - 840,000; Full time

Job summary

Side is seeking an AI Quality Engineer for a contractual 3-month assignment in Hyderabad. Work mode is WFO, 5 days a week, with extension depending on project needs.

The role focuses on testing and validating AI outputs, evaluating LLM and RAG systems for accuracy and hallucinations, validating retrieval quality and context relevance, and collaborating with AI/ML engineers to improve overall AI system quality.

Responsibilities

• Test and validate AI-generated insights, recommendations, and decision-making workflows.
• Evaluate LLM and RAG systems for accuracy, relevance, consistency, factuality, and hallucinations.
• Validate retrieval quality, context relevance, grounding, and response quality in RAG systems.
• Test AI agents and autonomous workflows across functional, negative, and edge-case scenarios.
• Define AI evaluation criteria, test datasets, quality metrics, and validation processes.
• Perform regression testing for models, prompts, RAG configurations, and AI workflows.
• Collaborate with AI/ML engineers to identify issues and improve AI system quality.

Job description

**AI Quality Engineer

**Location:- Hyderabad

**Work Mode:- WFO (5 days a week)

**Role Type:- Contractual (3 months and extension would depend on project requirement and performance)

Key Responsibilities

• Test and validate AI-generated insights, recommendations, and decision-making workflows.


• Evaluate LLM and RAG systems for accuracy, relevance, consistency, factuality, and hallucinations.


• Validate retrieval quality, context relevance, grounding, and response quality in RAG systems.


• Test AI agents and autonomous workflows across functional, negative, and edge-case scenarios.


• Define AI evaluation criteria, test datasets, quality metrics, and validation processes.


• Perform regression testing for models, prompts, RAG configurations, and AI workflows.


• Collaborate with AI/ML engineers to identify issues and improve AI system quality.