LEAD GEN AI QA Engineer

Quest Global; Maharashtra; On-site; INR 2,800,000 - 4,200,000; Full time

Job summary

Quest Global in Maharashtra, India, is seeking a seasoned QA Automation Engineer focused on AI-driven testing. You will join a cross-functional Scrum team to design, build, and maintain automation frameworks, run UI/API/perf tests, and help shape the testing strategy for GenAI-enabled solutions.

You will work with Playwright, Selenium, and other tools, contribute to feature testing, and collaborate with R&D and support groups to resolve complex product issues.

Qualifications

• Must have AI-first mindset and hands-on experience with AI-driven test harnesses.
• Strong knowledge of GenAI testing, evaluation methods, and tooling.
• Experience with RAG-based knowledge bases and related architectures.
• Experience building evaluation frameworks for GenAI/LLM applications.
• Familiarity with RAGAS and DeepEval evaluation methods.
• Exposure to AWS Bedrock and integrating LLMs with AI agents.
• Understanding of multi-agent systems, tool calling, and orchestration concepts.
• Proficient in Python, Java, and JavaScript.
• Hands-on with Playwright, Rest Assured, K6, Selenium for UI/API/perf tests.
• Minimum 4+ years in software development and framework design.
• Proven 1.5+ years building AI-driven test automation solutions.
• Ability to design and develop reusable test automation frameworks and libraries.
• Strong UI, API, and performance test automation experience.
• Experience with Java, Python, SQL, and Shell scripting.
• GIT version control experience; solid testing concepts and project management knowledge.

Responsibilities

• Be part of a cross functional Scrum team that develops and supports the product.
• Run manual tests and build automation test suites for regression and new features.
• Test UI components, verify data in databases, and automate deployment/data generation.
• Contribute to new features by advising POs and developers on expected system behavior.
• Install and configure testing systems with the latest deliveries for testing.
• Support customers and the support groups by analyzing and solving product issues.
• Interface with various R&D and services groups.

Skills

AI-first mindset

AI test harnesses

RAG & knowledge base

GenAI & LLM eval frameworks

RAGAS & DeepEval

AWS Bedrock integration

Agentic AI architectures

Python, Java, JavaScript

Playwright, Rest Assured, K6, Selenium

4+ years in software development

AI-driven test harnesses (1.5+ yrs)

Test automation framework design

UI/API/perf test automation

Java, Python, SQL, Shell Script

Git version control

Testing concepts & project management

Tools

Playwright

Rest Assured

K6

Selenium

Git

Job description

Job Requirements

At Quest Global, it’s not just what we do but how and why we do it that makes us different. With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. Our people are driven by the desire to make the world a better place—to make a positive difference that contributes to a brighter future. We bring together technologies and industries, alongside the contributions of diverse individuals who are empowered by an intentional workplace culture, to solve problems better and faster.

Job Requirements

At Quest Global, it’s not just what we do but how and why we do it that makes us different. With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. Our people are driven by the desire to make the world a better place—to make a positive difference that contributes to a brighter future. We bring together technologies and industries, alongside the contributions of diverse individuals who are empowered by an intentional workplace culture, to solve problems better and faster.

Key Responsibilities

• Be part of a cross functional Scrum team that develops and supports the product. You will be working hand in hand with the other R&D functions.
• Run manual tests and build automation test suits for regression and new features. Testing UI components, checking data in databases, automating deployment and data generation.
• Be involved in new features development, provide inputs to POs and Developers on the correct behaviour of the system.
• Install and Configure testing systems with latest deliveries for testing.
• Supporting customers and the support groups by analysing and solving product issues
• Interface with various R&D groups, as well as support and services groups
• Required Skills and Experience

We are known for our extraordinary people who make the impossible possible every day. Questians are driven by hunger, humility, and aspiration. We believe that our company culture is the key to our ability to make a true difference in every industry we reach. Our teams regularly invest time and dedicated effort into internal culture work, ensuring that all voices are heard.

We wholeheartedly believe in the diversity of thought that comes with fostering a culture rooted in respect, where everyone belongs, is valued, and feels inspired to share their ideas. We know embracing our unique differences makes us better, and that solving the worlds hardest engineering problems requires diverse ideas, perspectives, and backgrounds. We shine the brightest when we tap into the many dimensions that thrive across over 21,000 difference-makers in our workplace.

Work Experience

Years of Experience: 6-8 years

Must Have Skills

• AI-first mindset
• Experience in building test harnesses using AI tools such as GitHub Copilot, Claude Code, Codex, Cursor, and similar platforms
• Understanding of RAG (Retrieval-Augmented Generation) and knowledge base architectures
• Experience creating evaluation frameworks for GenAI and LLM-based applications
• Understanding of evaluation frameworks such as RAGAS and DeepEval
• Exposure to and experience with AWS Bedrock, including integrating Bedrock-hosted LLMs with AI agents
• Understanding of Agentic AI architectures, multi-agent systems, tool calling, and workflow orchestration concepts.
• Proficiency in programming languages such as Python, Java, and JavaScript
• Experience with automation and performance testing tools such as Playwright, Rest Assured, K6, Selenium, and similar frameworks
• Minimum 4+ years of hands‑on experience in software development, framework design, and coding
• Proven experience of 1.5+ years in building AI‑driven test harnesses and automation solutions using AI‑assisted development tools and platforms
• Design and develop the test automation framework, harnesses and code libraries to enable the team to use as well as enhance them across successive projects.
• Strong experience in UI, API, and performance test automation using Playwright, Selenium, Rest Assured, and K6.
• Experience in scripting and programming languages (Java, Python, SQL, Shell Script).
• Hands on experience in version management tools such as GIT.
• In-depth knowledge of Testing concepts and Test Project management.

Nice To Have Skills

• Good consulting, communication, convincing, presentation skills and Negotiation Skill