Automation Test Analyst - Talent Pool

Discovery; Sandton; Hybrid; ZAR 540,000 - 900,000; Full time

Job summary

Discovery Insure is seeking an Automation Test Analyst (AI & Automation) to design, build and maintain scalable automation frameworks for UI, API and performance testing. The role focuses on a platform-first approach, validating shared capabilities across tenants and configuring multi-tenant test suites.

You will work with AI-assisted testing tools and test AI-enabled features, ensure tests run in CI/CD pipelines, and collaborate with developers and product owners to deliver high quality

Qualifications

• Strong programming skills in Java (Essential).
• Hands-on UI automation with Selenium, Playwright or Cypress.
• API testing experience with REST/SOAP using Postman/Newman, SoapUI or REST Assured.
• Strong SQL and test data management, including service mocking.
• Design automation frameworks from scratch (Page Object Model, data-driven, BDD).
• Experience with CI/CD pipelines (Azure DevOps, GitHub Actions, Jenkins).
• Familiarity with AI-assisted testing tools and testing AI/ML features.

Responsibilities

• Design, build and maintain automation frameworks for web, API and mobile.
• Apply platform-first approach to tenant/configuration-driven testing.
• Create reusable, configurable automated test suites across tenants.
• Identify test conditions, create test designs, cases and data with risk-based testing.
• Integrate tests into CI/CD pipelines to run on every build.
• Monitor test execution and report quality and automation metrics.
• Review test specifications and coach junior testers in automation standards.
• Evaluate AI-enabled features for accuracy, bias, and reliability.
• Perform non-functional testing including performance, security and accessibility.
• Collaborate with agile teams to build quality in from the start.

Skills

Java

Python

JavaScript/TypeScript

C#

UI automation

Test design

CI/CD

AI testing

Education

Bachelor's degree in Computer Science or related field

ISTQB Foundation Level

ISTQB AI Testing (CT-AI)

Cloud/DevOps certification

Tools

Selenium WebDriver

Playwright

Cypress

Postman/Newman

SoapUI

REST Assured

Karate

JMeter

k6

Appium

Git/GitHub

Azure DevOps

Jenkins

Job description

Discovery – Insure

Automation Test Analyst (AI & Automation) – Vitality Drive International

About Discovery

Discovery’s core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional individuals who understand and support our core purpose, and whose own values align with those of Discovery. Our fast-paced and dynamic environment enables smart, self-driven people to be their best. As global thought leaders, Discovery is passionate about innovating in order to not only achieve financial success, but to ignite positive and meaningful change within our society.

Discovery – Insure

Automation Test Analyst (AI & Automation) – Vitality Drive International

About Discovery

Discovery’s core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional individuals who understand and support our core purpose, and whose own values align with those of Discovery. Our fast-paced and dynamic environment enables smart, self-driven people to be their best. As global thought leaders, Discovery is passionate about innovating in order to not only achieve financial success, but to ignite positive and meaningful change within our society.

About Discovery Insure

Discovery Insure is committed to creating a nation of great drivers through our innovative Shared-value Insurance model. Discovery Insure is South Africa’s fastest growing short-term insurance company with comprehensive products that provide protection against current and emerging risks facing clients in the motor and home insurance sectors. Vitality Drive, an internationally-recognised and award-winning programme, is a key differentiator in the market that incentivises and rewards clients for driving well. The Vitality Drive programme has been scaled to local and international markets which now include Europe and the Middle East. The company employs over 1 000 people who are committed to putting our customers and financial advisers first by providing unique and innovative solutions and cover.

Key Purpose

Design, build and maintain scalable automation frameworks and test suites (UI, API, mobile and performance) that run within CI/CD pipelines, with a platform-first approach that supports configurable, multi-tenant solutions and validates behaviour across different tenant configurations, and apply AI-assisted testing tools and techniques to improve speed, coverage and quality, including the testing of AI-enabled products and features.

Areas of responsibility may include but are not limited to:

• - Design, build and maintain automation frameworks and test scripts for front end (web and mobile), API and back-end services.
• - Apply a platform-first approach to test automation, ensuring automated tests validate core platform functionality as well as tenant-specific configuration, rules and behaviour.
• - Design reusable, configuration-driven automated test suites that can execute across multiple tenants and configurations without duplicating test scripts for each implementation.
• - Identify test conditions and create test designs, test cases, test procedure specifications and test data, applying risk-based testing techniques.
• - Integrate automated test suites into CI/CD pipelines so that tests run on every build, and execute, log and evaluate the results, documenting problems found.
• - Monitor test execution and test environments, and gather and report on quality and automation metrics (coverage, pass rates, defect trends and execution times).
• - Review work, including test specifications, defect reports and test results, and coach junior testers on automation standards.
• - Review and contribute to test strategies and test plans, and analyse, review and assess requirements and design specifications early in the delivery cycle.
• - Use AI-assisted tools (e.g. GitHub Copilot, self-healing and visual AI testing tools) to generate test cases, scripts and test data, and to speed up failure analysis.
• - Test AI-enabled features (e.g. chatbots, LLMs and machine learning models) for accuracy, hallucinations, bias, consistency and prompt-injection risk.
• - Perform non-functional testing, including performance, load, security and accessibility testing.
• - Work in agile delivery teams with developers, business analysts and product owners to build quality in from the start.

Knowledge And Skills

• - Strong programming skills in Java (Essential), with Python, JavaScript/TypeScript or C# (Advantageous).
• - Hands-on experience with UI automation tools such as Selenium WebDriver, Playwright or Cypress.
• - API testing (REST and SOAP) using tools such as Postman/Newman, SoapUI, REST Assured or Karate.
• - Strong SQL and test data management skills, including service mocking (e.g. WireMock).
• - Designing and setting up automation frameworks from scratch, including Page Object Model, data-driven, keyword-driven and BDD (Cucumber/Gherkin) approaches.
• - Platform and multi-tenant testing: strong understanding of configurable platform architectures and the ability to design automation that validates shared platform capabilities across different tenant configurations, feature flags, rules and integrations.
• - Ability to distinguish between platform defects, configuration defects and tenant-specific implementation defects, and design test coverage accordingly.
• - Ability to write test scripts from scratch and build and maintain a reusable test library.
• - Integrating tests into CI/CD pipelines using tools such as Azure DevOps, GitHub Actions or Jenkins, and running them across different environments.
• - Performance testing tools such as JMeter or k6, and mobile testing with Appium.
• - Version control with Git/GitHub, and defect and test management in Jira.
• - AI-assisted testing tools such as GitHub Copilot, Testim, Mabl, Applitools, Tricentis Tosca or Katalon.
• - Testing AI and LLM-based solutions using evaluation frameworks such as DeepEval, Ragas or promptfoo (Advantageous).
• - Understanding of responsible AI principles, including bias and fairness, explainability and data privacy (POPIA).
• - Working knowledge of cloud platforms (Azure or AWS) and containers (Docker).
• - Awareness of security testing basics (OWASP Top 10).
• - Writing and Reporting, including explaining defect risk in business terms to non-technical stakeholders.
• - Learning and Researching, with a commitment to keeping up with fast-changing AI and automation tools.
• - Planning & Organising.
• - Delivering Results and Meeting Customer Expectations.
• - Coping with Pressure and Setbacks.
• - Assisting in collating training documentation.
• - Critical, curious thinking and a strong quality-advocacy mindset.
• - Change management and operating model design (Intermediate) – (Preferred)

Education And Experience

Education:

• - Matric (Essential).
• - Bachelor's degree in Computer Science, Information Systems, Engineering or a related field (or equivalent experience).
• - ISTQB Certified Tester Foundation Level (Essential); ISTQB Advanced Test Automation Engineer or a recognised test automation certificate (Advantageous).
• - ISTQB Certified Tester AI Testing (CT-AI) or Microsoft Azure AI Fundamentals (AI-900) (Advantageous).
• - Cloud or DevOps certification, such as Microsoft Azure AZ-900 or AZ-400 (Advantageous).

Experience

• - 3-5 years as an Automation Test Analyst, including building automation frameworks from scratch (Essential).
• - 1 Year Test Analysis in a short-term insurance environment (Advantageous).
• - Experience integrating automated tests into CI/CD pipelines (Essential).
• - Experience testing AI/ML or LLM-based solutions, or using AI tools within the testing process (Advantageous).
• - Experience mentoring junior testers (Advantageous).

EMPLOYMENT EQUITY

The Company’s approved Employment Equity Plan and Targets will be considered as part of the recruitment process. As an Equal Opportunities employer, we actively encourage and welcome people with various disabilities to apply.