Lead Quality Engineer - R01569777

Brillio; Bengaluru; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Brillio is seeking a Lead Quality Engineer in Bengaluru to own testing strategy for AI-enabled health concierge web apps and microservices. You will design and execute test plans, validate AI outputs, and ensure API and UI quality across complex workflows.

The role emphasizes hands-on testing, automation in Jenkins/Selenium, and accessibility testing with JAWS, collaborating with product and AI teams to drive continuous quality improvements.

Qualifications

• Experience in quality engineering for web applications and microservices.
• Hands-on testing of AI-enabled applications.

Responsibilities

• Design and implement comprehensive test strategies for traditional and AI-powered features.
• Develop and execute detailed test scenarios across provider search, facility search, symptom guidance, benefits navigation, cost estimation, claims status, and contact center handoff modules.
• Perform functional, regression, integration, and system testing for web apps and microservices.
• Validate chatbot conversations, AI-generated responses, and RAG-based retrieval accuracy.
• Conduct API and integration testing for various provider and cost estimation services.
• Collaborate with Product Owners, AI Architects, Developers, and Business SMEs to improve quality practices.
• Leverage automation tools like Selenium and Jenkins to streamline testing workflows.
• Perform accessibility testing using JAWS to ensure standards compliance.

Skills

Test Data Management

BDD

TDD

Accessibility Testing

System Integration Testing

Education

Bachelor's degree in Computer Science / IT or related

Tools

Jenkins

Postman

Selenium

SoapUI

Zephyr

Cucumber

Job description

Lead Quality Engineer

Primary Skills

• Test Data Management, Jenkins, Postman, Selenium, BDD - Behavior Driven Development, SoapUI, System Integration testing, Zephyr, TDD - Test Driven Development, Accessibility Testing (JAWS), Cucumber

Job requirements

Experience Range

With at least 4 years of experience in quality engineering for web applications and microservices, including hands-on testing of AI-enabled applications

Key Responsibilities

• Design and implement comprehensive test strategies for traditional and AI-powered features within the Personal Health Concierge platform, prioritizing high-impact areas
• Develop and execute detailed test scenarios based on business requirements and acceptance criteria across provider search, facility search, symptom guidance, benefits navigation, cost estimation, claims status, and contact center handoff modules
• Perform functional, regression, integration, and system testing to ensure measurable quality and compliance of web applications and microservices
• Validate chatbot conversations, AI-generated responses, and RAG-based retrieval accuracy, ensuring prompt behavior and guardrail compliance for healthcare-specific use cases
• Conduct API and integration testing for provider directory APIs, benefits and eligibility APIs, claims APIs, cost estimation services, AI gateway services, and contact center integrations
• Collaborate with Product Owners, AI Architects, Developers, and Business SMEs to establish robust quality engineering practices and drive continuous improvement
• Leverage automation tools such as Selenium and Jenkins to streamline testing workflows and increase coverage
• Perform accessibility testing using JAWS to ensure compliance with accessibility standards across the platform

Required Skills

1. Jenkins
2. Postman
3. Selenium
4. Behavior Driven Development (BDD)
5. SoapUI
6. System Integration Testing
7. Zephyr
8. Test Driven Development (TDD)
9. Accessibility Testing with JAWS

Preferred Skills

1. Cucumber
2. AI validation and conversational testing
3. Healthcare domain expertise
4. Advanced API automation
5. Experience with contact center integrations (Avaya)
6. RAG (Retrieval-Augmented Generation) testing

Desired Qualifications

1. Bachelor's degree in Computer Science, Information Technology, or a closely related discipline
2. Certified Software Quality Engineer (CSQE) or ISTQB Advanced Level Test Analyst certification
3. Certification in AI or Machine Learning testing methodologies (preferred for AI-enabled application testing)

Additional Information

This is a QA Engineer role focused on AI-enabled applications, not a typical QA position.