Lead QA Engineer - AI

Quest Global; Bengaluru; On-site; INR 2,000,000 - 3,200,000; Full time

Job summary

Quest Global is seeking an experienced Software Test Automation Engineer to lead AI/ML testing efforts and validate AI-driven cloud orchestration. You will design scalable test suites, work with cloud platforms (AWS, Azure, GCP), and integrate tests into CI/CD pipelines to ensure robust, secure AI deployments.

You will collaborate with Data and Cloud Engineers to craft synthetic data, validate model boundaries, and tackle non-deterministic outcomes common in AI-enabled environments.

Qualifications

• 6-9 years in software test automation with at least 1 year testing AI/ML applications or MLOps pipelines.
• Cloud expertise: AWS, Azure, or GCP operations and APIs.
• Programming: Python, Java, or Go for test script development.
• AI/ML concepts: NLP, model evaluation metrics, and reinforcement learning.
• Hands-on with PyTest, Selenium, Playwright, Postman, REST Assured for API testing.

Responsibilities

• Drive the quality of Agentic AI systems that autonomously provision, monitor, and scale cloud infrastructure.
• Design, develop, and maintain intelligent test suites to validate AI model behaviors, API reliability, and secure workflows.
• Build scalable AI-driven test automation frameworks using Python or Java.
• Test agentic AI workflows that trigger, configure, or terminate cloud resources and monitor responses.
• Collaborate with Data and Cloud Engineers to create synthetic datasets for robust testing and drift detection.
• Integrate self-healing test suites into CI/CD pipelines (Jenkins, GitLab) for zero-touch deployments.
• Validate cloud security models, compliance, and RBAC enforced by AI.

Skills

AI/ML knowledge

Problem solving

Tools

Python

Java

Go

AWS

Azure

GCP

PyTest

Selenium

Playwright

Postman

REST Assured

Jenkins

GitLab

Job description

Job Requirements

At Quest Global, it’s not just what we do but how and why we do it that makes us different. With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. Our people are driven by the desire to make the world a better place—to make a positive difference that contributes to a brighter future. We bring together technologies and industries, alongside the contributions of diverse individuals who are empowered by an intentional workplace culture, to solve problems better and faster.

Key Responsibilities

Drive the quality of Agentic AI systems built to autonomously provision, monitor, and scale cloud infrastructure. You will design, develop, and maintain intelligent test suites to validate complex AI model behaviors, API reliability, and secure cloud orchestration workflows across platforms like AWS, Azure, or GCP.

• Typical experience should include:
  • LLM validation against queries (this is not dependent on dev team). Simulate prompts and inform dev team which LLM is best
  • MCP testing
  • Connectivity testing
  • Guardrail testing
  • A2A testing
  • Request Handler testing
  • Orchestrator agent testing
• Build scalable, AI-driven test automation frameworks using Python or Java to validate LLM-based cloud orchestration decisions.
• Test agentic AI workflows that autonomously trigger, configure, or terminate cloud resources and monitor system responses.
• Collaborate with Data Engineers and Cloud Engineers to create synthetic datasets that reliably test AI model boundaries, edge cases, and drift.
• Integrate intelligent self-healing test suites into existing CI/CD pipelines (e.g., Jenkins, GitLab) to ensure zero-touch deployments.
• Perform rigorous validation of cloud security models, compliance, and RBAC implementations enforced by AI.
• Utilize AI-testing platforms to accelerate test generation and execution.

We are known for our extraordinary people who make the impossible possible every day. Questians are driven by hunger, humility, and aspiration. We believe that our company culture is the key to our ability to make a true difference in every industry we reach. Our teams regularly invest time and dedicated effort into internal culture work, ensuring that all voices are heard.

We wholeheartedly believe in the diversity of thought that comes with fostering a culture rooted in respect, where everyone belongs, is valued, and feels inspired to share their ideas. We know embracing our unique differences makes us better, and that solving the worlds hardest engineering problems requires diverse ideas, perspectives, and backgrounds. We shine the brightest when we tap into the many dimensions that thrive across over 21,000 difference-makers in our workplace.

Work Experience

• Experience: 6-9 years in software test automation, with at least 1 year specifically testing AI/ML applications or MLOps pipelines.
• Cloud Expertise: Strong working knowledge of AWS, Microsoft Azure, or Google Cloud Platform (GCP) operations and APIs.
• Programming: Advanced proficiency in Python, Java, or Go for building custom test scripts.
• AI/ML Knowledge: Familiarity with concepts like natural language processing, model evaluation metrics, and reinforcement learning.
• Tools: Hands-on experience with testing frameworks like PyTest, Selenium, or Playwright, along with API testing tools (Postman, REST Assured).
• Mindset: Strong problem-solving skills to tackle non-deterministic outcomes common in AI-automated environments.