Qa Engineer (AI & Automation)

Advancesoft India Hyderabad; Hyderabad; On-site; INR 900,000 - 1,200,000; Full time

Job summary

Advancesoft India Hyderabad is seeking a QA Engineer AI & Automation in Bangalore to drive quality for our AI-powered Agent Platform. You will build AI evaluation frameworks, automate tests and ensure robust release quality for voice and chat experiences.

Ideal candidates have 4+ years of QA/Automation, strong Playwright and API testing skills, and experience with AI/LLM testing, evals and regression testing across AI products.

Qualifications

• 4+ years of QA/Automation experience.
• Experience with AI/LLM testing and evaluation.
• Proficiency with Playwright and API testing.
• Validation of AI responses, bias and user experience.

Responsibilities

• Build and maintain AI evaluation frameworks and automated test suites.
• Validate AI-powered voice and chat experiences.
• Drive release quality, regression testing and automation initiatives.
• Collaborate with Product, Engineering and AI teams.

Skills

QA Automation

Playwright

API Testing

End-to-End Testing

AI/LLM Testing

ChatGPT Enterprise

GitHub Copilot

Codex

AI testing tools

Tools

Playwright

Rest Assured

GitHub Copilot

Codex

Job description

Hiring: QA Engineer AI & Automation | Bangalore

Location: Bangalore

Experience: 4+ Years

Notice Period: Immediate to 15 Days

CTC: Best in Industry

We are looking for a QA Engineer AI & Automation to drive quality assurance for our AI-powered Agent Platform.

Key Skills:

• QA Automation amp; Quality Engineering
• Playwright amp; Rest Assured
• API & End-to-End Testing
• AI/LLM Testing, Evals & Regression Testing
• Validation of AI responses, hallucinations, bias & user experience
• Experience with
• ChatGPT Enterprise,
• GitHub Copilot,
• Codex, and
• AI-assisted testing tools

What Youll Do:

• Build and maintain AI evaluation frameworks and automated test suites.
• Validate AI-powered voice and chat experiences.
• Drive release quality, regression testing, and automation initiatives.
• Work closely with Product, Engineering, and AI teams.