Lead Quality Engineer - R01569777

Brillio 2; Bengaluru; On-site; INR 900,000 - 2,000,000; Full time

Job summary

Brillio seeks a Lead Quality Engineer to drive QA for AI-enabled web apps and microservices in the Personal Health Concierge platform. You will shape test strategy and automation across AI features, ensuring scalable quality.

Responsibilities include designing test scenarios for provider/search, cost estimation, claims, and chatbot validation; collaborating with product and AI teams; and using Selenium/Jenkins with accessibility testing to meet healthcare standards.

Qualifications

• Bachelor's degree required in CS/IT or related field.
• CSQE or ISTQB Advanced Level Test Analyst preferred.
• Certification in AI/ML testing is a plus.

Responsibilities

• Design and implement test strategies for traditional and AI-powered features.
• Develop and execute test scenarios across provider search, facility search, symptom guidance, benefits navigation, cost estimation, claims status, and contact center modules.
• Perform functional, regression, integration, and system testing for web apps and microservices.
• Validate chatbot conversations, AI-generated responses, and RAG-based retrieval accuracy.
• Conduct API and integration testing for various provider, benefits, claims, AI gateway, and contact center services.
• Collaborate with Product Owners, AI Architects, Developers, and SMEs to improve QA practices.
• Leverage Selenium and Jenkins to streamline testing and increase coverage.
• Perform accessibility testing with JAWS to meet standards.

Skills

BDD

TDD

AI validation

RAG testing

AI-enabled testing

Healthcare domain

API automation

QA strategy

Test design

Education

Bachelor's degree in Computer Science/IT

CSQE ISTQB Advanced

AI/ML testing certification

Tools

Jenkins

Postman

Selenium

SoapUI

Zephyr

Job description

Lead Quality Engineer

Test Data Management, Jenkins, Postman, Selenium, BDD - Behavior Driven Development, SoapUI, System Integration testing, Zephyr, TDD - Test Driven Development, Accessibility Testing (JAWS), Cucumber

Experience Range: With at least 4 years of experience in quality engineering for web applications and microservices, including hands-on testing of AI-enabled applications

Key Responsibilities

• Design and implement comprehensive test strategies for traditional and AI-powered features within the Personal Health Concierge platform, prioritizing high-impact areas
• Develop and execute detailed test scenarios based on business requirements and acceptance criteria across provider search, facility search, symptom guidance, benefits navigation, cost estimation, claims status, and contact center handoff modules
• Perform functional, regression, integration, and system testing to ensure measurable quality and compliance of web applications and microservices
• Validate chatbot conversations, AI-generated responses, and RAG-based retrieval accuracy, ensuring prompt behavior and guardrail compliance for healthcare-specific use cases
• Conduct API and integration testing for provider directory APIs, benefits and eligibility APIs, claims APIs, cost estimation services, AI gateway services, and contact center integrations
• Collaborate with Product Owners, AI Architects, Developers, and Business SMEs to establish robust quality engineering practices and drive continuous improvement
• Leverage automation tools such as Selenium and Jenkins to streamline testing workflows and increase coverage
• Perform accessibility testing using JAWS to ensure compliance with accessibility standards across the platform

Required Skills

• Jenkins
• Postman
• Selenium
• Behavior Driven Development (BDD)
• SoapUI
• System Integration Testing
• Zephyr
• Test Driven Development (TDD)
• Accessibility Testing with JAWS

Preferred Skills

• Cucumber
• AI validation and conversational testing
• Healthcare domain expertise
• Advanced API automation
• Experience with contact center integrations (Avaya)
• RAG (Retrieval-Augmented Generation) testing

Desired Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a closely related discipline
• Certified Software Quality Engineer (CSQE) or ISTQB Advanced Level Test Analyst certification
• Certification in AI or Machine Learning testing methodologies (preferred for AI-enabled application testing)

Additional Information

This is a QA Engineer role focused on AI-enabled applications, not a typical QA position.