QA Engineer(AI)

National e-Governance Division

New Delhi

On-site

INR 3,500,000 - 5,000,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

National e-Governance Division in Delhi is seeking a QA Lead – AI to oversee QA for AI-powered applications. You will manage QA teams, define testing strategies and drive automation and AI testing initiatives.

The role requires 7+ years in QA with 3+ years in leadership, hands-on AI/ML testing, and strong skills in Selenium, API testing and JIRA. You will collaborate with DevOps and AI teams to ensure release readiness.

Qualifications

  • 7+ years of experience in QA and Software Testing, including 3+ years in a leadership role.
  • Hands‑on experience in AI/ML and Generative AI application testing is mandatory.
  • Experience in LLM testing, prompt testing and AI response validation.
  • Knowledge of hallucination detection and RAG testing.
  • Strong experience in Selenium, Cypress, Playwright or equivalent automation tools.
  • Experience with API testing tools such as Postman and Rest Assured.
  • Familiarity with JIRA, TestRail and Agile methodologies.
  • Strong leadership, analytical and stakeholder management skills.

Responsibilities

  • Lead and mentor QA engineers and oversee end-to-end testing activities.
  • Develop test strategies, test plans and automation frameworks.
  • Manage functional, integration, regression, API and performance testing.
  • Perform testing of AI/ML-based applications, Generative AI and LLM-powered solutions.
  • Validate AI-generated responses for accuracy, relevance and consistency.
  • Identify AI hallucinations, bias, incorrect outputs and prompt‑related issues.
  • Perform testing of AI chatbots, RAG‑based applications and conversational AI solutions.
  • Drive test automation and AI-based testing initiatives.
  • Coordinate with development, DevOps and AI/ML teams.
  • Monitor defect resolution, quality metrics and release readiness.

Skills

QA leadership
AI/ML testing
Automation testing
Selenium
Cypress
Playwright
API testing
Agile methodologies
JIRA
LLM testing

Education

Bachelor's degree in CS/IT/Engineering
Master's in CS/AI/ML

Tools

Postman
Rest Assured
JIRA
TestRail

Job description

Job Description QA Engineer(AI)

Experience: 5+ Years
Location: Delhi

Role Overview

The QA Lead – AI will lead the quality assurance function, ensuring the reliability, performance and accuracy of software applications and AI-powered solutions. The candidate will manage QA teams, define testing strategies and drive automation and AI testing initiatives.

Key Responsibilities
  • Lead and mentor QA engineers and oversee end-to-end testing activities.
  • Develop test strategies, test plans and automation frameworks.
  • Manage functional, integration, regression, API and performance testing.
  • Perform testing of AI/ML-based applications, Generative AI and LLM-powered solutions.
  • Validate AI-generated responses for accuracy, relevance and consistency.
  • Identify AI hallucinations, bias, incorrect outputs and prompt‑related issues.
  • Perform testing of AI chatbots, RAG‑based applications and conversational AI solutions.
  • Drive test automation and AI-based testing initiatives.
  • Coordinate with development, DevOps and AI/ML teams.
  • Monitor defect resolution, quality metrics and release readiness.
Required Skills & Experience
  • 7+ years of experience in QA and Software Testing, including 3+ years in a leadership role.
  • Hands‑on experience in AI/ML and Generative AI application testing is mandatory.
  • Experience in LLM testing, prompt testing and AI response validation.
  • Knowledge of hallucination detection and RAG testing.
  • Strong experience in Selenium, Cypress, Playwright or equivalent automation tools.
  • Experience with API testing tools such as Postman and Rest Assured.
  • Familiarity with JIRA, TestRail and Agile methodologies.
  • Strong leadership, analytical and stakeholder management skills.
Education
  • Bachelor's degree in Computer Science, Information Technology, Engineering or a related field.
  • Master's degree in Computer Science, AI/ML or a related discipline will be an added advantage.
  • Relevant certifications in Software Testing, Test Automation, AI/ML or Generative AI will be preferred
Preferred

Experience in testing AI-powered enterprise applications, LLM-based platforms, AI chatbots and automated AI evaluation frameworks.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

QA Manual Engineer - AI Applications-India
QA Manual Engineer - AI Applications-India

RELQ TECHNOLOGIES • Thiruvananthapuram

Remote
INR 1,800,000 - 3,000,000
QA Lead
QA Lead

Nura Analytics • Chennai District

On-site
INR 1,200,000 - 1,500,000
QA Engineer
QA Engineer

TigerHire • India

Remote
INR 1,200,000 - 2,000,000
Gen AI QA Engineer
Gen AI QA Engineer

Deqode • Bengaluru

On-site
INR 1,200,000 - 2,100,000
AI Test Lead
AI Test Lead

Team Geek Solutions • Hyderabad

On-site
INR 1,500,000 - 2,100,000
Senior QA Engineer, AI
Senior QA Engineer, AI

Intercontinental Exchange Holdings, Inc. • Hyderabad

On-site
INR 2,000,000 - 4,000,000
Senior QA Engineer, AI
Senior QA Engineer, AI

ICE • Hyderabad

On-site
INR 1,800,000 - 3,000,000
QA Engineer(Work from Office)
QA Engineer(Work from Office)

VettedBench • India

On-site
INR 500,000 - 1,000,000
Generative AI Engineer
Generative AI Engineer

Tekskills Inc. • Pune District

On-site
INR 1,200,000 - 1,600,000
QA Automation Engineer - AI Labs
QA Automation Engineer - AI Labs

Idfc First Bank Limited • Bengaluru

On-site
INR 900,000 - 1,300,000