Job Description QA Engineer(AI)
Experience: 5+ Years
Location: Delhi
Role Overview
The QA Lead – AI will lead the quality assurance function, ensuring the reliability, performance and accuracy of software applications and AI-powered solutions. The candidate will manage QA teams, define testing strategies and drive automation and AI testing initiatives.
Key Responsibilities
- Lead and mentor QA engineers and oversee end-to-end testing activities.
- Develop test strategies, test plans and automation frameworks.
- Manage functional, integration, regression, API and performance testing.
- Perform testing of AI/ML-based applications, Generative AI and LLM-powered solutions.
- Validate AI-generated responses for accuracy, relevance and consistency.
- Identify AI hallucinations, bias, incorrect outputs and prompt‑related issues.
- Perform testing of AI chatbots, RAG‑based applications and conversational AI solutions.
- Drive test automation and AI-based testing initiatives.
- Coordinate with development, DevOps and AI/ML teams.
- Monitor defect resolution, quality metrics and release readiness.
Required Skills & Experience
- 7+ years of experience in QA and Software Testing, including 3+ years in a leadership role.
- Hands‑on experience in AI/ML and Generative AI application testing is mandatory.
- Experience in LLM testing, prompt testing and AI response validation.
- Knowledge of hallucination detection and RAG testing.
- Strong experience in Selenium, Cypress, Playwright or equivalent automation tools.
- Experience with API testing tools such as Postman and Rest Assured.
- Familiarity with JIRA, TestRail and Agile methodologies.
- Strong leadership, analytical and stakeholder management skills.
Education
- Bachelor's degree in Computer Science, Information Technology, Engineering or a related field.
- Master's degree in Computer Science, AI/ML or a related discipline will be an added advantage.
- Relevant certifications in Software Testing, Test Automation, AI/ML or Generative AI will be preferred
Preferred
Experience in testing AI-powered enterprise applications, LLM-based platforms, AI chatbots and automated AI evaluation frameworks.