We are looking for an experienced Testing Lead with strong expertise in Selenium, Java, API testing, and airline booking systems, along with hands-on experience in Chatbot and LLM/GenAI testing.
The candidate will lead QA activities across web applications, APIs, airline booking workflows, conversational AI, and AI/LLM-based solutions. The role requires strong technical leadership, test strategy development, automation expertise, and the ability to work closely with product, engineering, business, and AI teams.
Key Responsibilities
- Lead end-to-end QA strategy, planning, execution, and delivery for airline/travel technology products.
- Design and implement robust UI automation frameworks using Selenium and Java.
- Develop and maintain automated regression, functional, integration, and end-to-end test suites.
- Perform API testing using tools such as REST Assured, Postman, or equivalent.
- Validate airline booking workflows including:
- Flight search and availability
- Fare and pricing validation
- Booking creation and modification
- PNR generation and retrieval
- Ticketing and cancellation
- Refunds and rebooking
- Ancillaries and seat selection
- Multi-segment and international itineraries
- Define test scenarios covering complex airline business rules, integrations, and downstream/upstream systems.
- Lead Chatbot testing, including conversational flows, intent recognition, entity extraction, fallback handling, context retention, and response accuracy.
- Develop testing approaches for LLM/GenAI applications, including:
- Prompt and response validation
- Accuracy and relevance
- Consistency and robustness
- Prompt injection and adversarial testing
- Guardrails and safety validation
- Response latency and performance
- Regression testing for model/prompt changes
- Establish quality metrics, defect KPIs, automation coverage, and release-readiness criteria.
- Review test cases, automation code, defect reports, and QA deliverables.
- Mentor QA engineers and provide technical leadership across the testing team.
- Collaborate with developers, product owners, business analysts, DevOps, and AI/ML teams.
- Identify opportunities to improve automation coverage, testing efficiency, and overall product quality.
- Participate in Agile ceremonies, sprint planning, refinement, reviews, and retrospectives.
- Drive defect triage, root-cause analysis, and resolution tracking.
- Ensure testing standards, processes, and best practices are consistently followed.
Required Technical Skills
Automation
- Strong hands-on experience with Selenium WebDriver.
- Strong programming skills in Java.
- Experience building or maintaining automation frameworks using TestNG/JUnit, Maven/Gradle, and Page Object Model.
- Experience with CI/CD integration using tools such as Jenkins, GitHub Actions, GitLab CI, or equivalent.
- Strong knowledge of Git and code-review practices.
API Testing
- Strong experience in REST API testing.
- Hands-on experience with REST Assured and/or Postman.
- Understanding of JSON, XML, HTTP methods, status codes, authentication, headers, and API validations.
- Experience validating end-to-end workflows involving multiple APIs and system integrations.
Airline / Booking Domain
- Strong understanding of airline reservation and booking systems.
- Experience testing flight search, availability, fares, PNR, booking, ticketing, cancellation, refund, rebooking, payments, and ancillary services.
- Knowledge of airline/travel domain standards and concepts such as GDS, NDC, PNR, fare rules, and ticketing is highly desirable.
- Experience testing integrations with airline, payment, GDS, or travel ecosystem systems is an advantage.
Chatbot & LLM Testing
- Hands-on experience testing chatbots, conversational AI, GenAI, or LLM-based applications.
- Understanding of NLP concepts such as intents, entities, context, conversation flows, and fallback mechanisms.
- Experience creating test datasets and evaluation criteria for LLM applications.
- Knowledge of LLM evaluation techniques such as relevance, factuality, groundedness, consistency, toxicity, and hallucination testing.
- Familiarity with prompt engineering and prompt-based testing.
- Understanding of AI-specific risks including prompt injection, data leakage, bias, and unsafe responses.
- Experience with AI testing/evaluation frameworks or tools is a plus.
Leadership & Soft Skills
- Proven experience leading QA teams and owning testing deliverables.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder-management skills.
- Ability to translate business requirements into comprehensive test strategies.
- Strong ownership of quality, timelines, and delivery commitments.
- Ability to mentor engineers and drive adoption of automation and modern QA practices.
- Comfortable working in a fast-paced Agile environment.
Preferred Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- Experience with cloud environments such as AWS, Azure, or GCP.
- Exposure to performance testing tools such as JMeter or Gatling.
- Experience with SQL/database validation.
- Familiarity with Docker/Kubernetes and CI/CD pipelines.
- Experience testing microservices and event-driven architectures.
- Experience with LLM/GenAI applications in production environments.
- Relevant QA/testing certifications such as ISTQB are a plus.
Key Success Metrics
- Automation coverage and reduction in manual regression effort.
- Defect detection effectiveness and reduction in production defects.
- API and UI automation stability.
- Coverage of critical airline booking journeys.
- Quality and reliability of chatbot/LLM responses.Release readiness and adherence to QA timelines.
- Continuous improvement in testing processes and frameworks.
Ideal Candidate
The ideal candidate is a hands-on QA/Test Lead who combines strong Java + Selenium + API automation expertise with deep airline booking domain knowledge and emerging expertise in Chatbot and LLM/GenAI testing. The candidate should be capable of both leading a QA team and contributing technically to automation, API validation, and AI quality engineering.