Senior AI QA Engineer

Albireo Recruiters; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Albireo Recruiters seeks a Senior Quality Assurance AI Engineer II to advance LLM evaluation and reliability for CloudAngles. The role focuses on designing evaluation frameworks, testing agentic workflows, and building automated test pipelines for generative AI microservices.

Candidates should possess strong experience with AI testing paradigms, prompt performance metrics, and safety guardrails to ensure robust, scalable AI systems.

Qualifications

• UG: B.Tech / B.E. in Any Specialization, B.Sc in Any Specialization, B.C.A. in Any Specialization.
• PG: MCA in Any Specialization, M.Tech in Any Specialization, MS/M.Sc(Science) in Any Specialization.

Responsibilities

• Designing LLM evaluation frameworks (Ragas, DeepEval, automated benchmarks).
• Testing agentic workflows, prompt performance, hallucination rates, and safety guardrails.
• Building automated test pipelines for generative AI microservices.

Skills

LLM evaluation

Automated benchmarks

Agentic workflows

Prompt testing

Hallucination control

Safety guardrails

Education

B.Tech/BE

B.Sc

BCA

MCA/M.Tech/MS/M.Sc

Job description

Senior Quality Assurance AI Engineer II CloudAngles

Key Focus

• Designing LLM evaluation frameworks (Ragas, DeepEval, automated benchmarks)
• Testing agentic workflows, prompt performance, hallucination rates, and safety guardrails
• Building automated test pipelines for generative AI microservices

UG: B.Tech / B.E. in Any Specialization, B.Sc in Any Specialization, B.C.A. in Any Specialization

PG: MCA in Any Specialization, M.Tech in Any Specialization, MS/M.Sc(Science) in Any Specialization

Key Skills

Skills highlighted with ‘‘ are preferred keyskills