Quality Engineer – AI & Agentic Testing

Zappi

Cape Town

On-site

ZAR 800,000 - 900,000

Full time

12 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Unlimited holidays
Mental health day quarterly
Office designed for collaboration
Private medical healthcare cover
Medical Aid
Group life & disability contributions
Wellbeing benefits (yoga, therapists)
Parking in Cape Town
Free coffee, lunches and snacks
Training allowances and mentorship

Job summary

Zappi, a fast-growing SaaS platform in Cape Town, is seeking a Quality Engineer to design, build and maintain automated test frameworks for APIs, GUI and performance. The role focuses on agentic testing, LLM-powered evaluations and data integrity across pipelines, with collaboration across Engineering, Product and Design.

You will integrate tests into CI, mentor peers and help shape testing strategies while ensuring high-quality releases in a dynamic, environmentally conscious company.

Qualifications

  • Strong foundations in software quality assurance and QA methodologies.
  • Hands-on experience with agentic engineering and LLM-powered systems.
  • Ability to own quality deliverables from planning to release.
  • Experience validating data and data pipelines.

Responsibilities

  • Design, build and maintain automated test frameworks and suites for APIs, GUI and performance, using Playwright(TS) where appropriate.
  • Apply agentic engineering techniques to build and improve testing workflows, including agent-assisted test generation, execution, failure investigation and reporting.
  • Develop and run LLM evaluations, test agent-based workflows and investigate failure modes involving reasoning, tool use, multi‑step execution and inconsistent outputs.
  • Work with engineers and product teams to clarify requirements, identify risks early and build testing into the development process from the outset.
  • Test from the customer’s perspective through manual and exploratory testing where it adds value, and automate repeatable checks to improve coverage and reduce regression risk.
  • Validate data integrity, test data pipelines and verify data transformations to ensure accuracy and consistency across systems.
  • Integrate and maintain automated tests within CI pipelines, analyse results and identify opportunities to improve test coverage and feedback.
  • Evaluate new AI and agentic tools, improve testing practices and mentor other QA engineers through collaboration and knowledge sharing.

Skills

QA methodologies
Test automation
Agentic engineering
LLM-powered systems
Independent work

Tools

Playwright TS
CI pipelines
AWS
Microservices
Data testing

Job description

Zappi, a fast-growing SaaS platform in Cape Town, is seeking a Quality Engineer to design, build and maintain automated test frameworks for APIs, GUI and performance. The role focuses on agentic testing, LLM-powered evaluations and data integrity across pipelines, with collaboration across Engineering, Product and Design.

You will integrate tests into CI, mentor peers and help shape testing strategies while ensuring high-quality releases in a dynamic, environmentally conscious company.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

QA Automation Engineer - AI & LLM Testing
QA Automation Engineer - AI & LLM Testing

ZappiStore • Cape Town

On-site
ZAR 800,000 - 900,000
Unlimited holidays
Mental health day each quarter
Office designed for collaboration
+7
Platform Engineering Lead - Infra & AI
Platform Engineering Lead - Infra & AI

ZappiStore • Cape Town

On-site
ZAR 1,300,000 - 1,600,000
Unlimited holidays
Mental health days
Private medical healthcare cover
+2
Senior Platform Engineering Manager — AI Infra Leader
Senior Platform Engineering Manager — AI Infra Leader

Zappi • Cape Town

On-site
ZAR 1,300,000 - 1,600,000
Unlimited holidays
Private medical healthcare cover
Medical Aid
+2
Senior Quality Engineer: Test Automation & Performance
Senior Quality Engineer: Test Automation & Performance

Zensar Technologies • Wes-Kaap

On-site
ZAR 600,000 - 900,000
Platform Engineering Lead: AI Infra & DevEx (Cape Town)
Platform Engineering Lead: AI Infra & DevEx (Cape Town)

ZappiStore • Cape Town

On-site
ZAR 1,300,000 - 1,600,000
Unlimited holidays
Mental health days
Office facilities
+7
Software Quality Engineer - Automation & CI/CD Lead
Software Quality Engineer - Automation & CI/CD Lead

ATS Client • Cape Town

On-site
ZAR 420,000 - 640,000
Automation Test Engineer – Quality at Speed
Automation Test Engineer – Quality at Speed

Sabenza IT & Recruitment • Cape Town

On-site
ZAR 480,000 - 600,000
Software Quality Engineer
Software Quality Engineer

Ats Client • Cape Town

On-site
ZAR 420,000 - 640,000
Software Development Engineer in Test
Software Development Engineer in Test

Zappi • Cape Town

On-site
ZAR 800,000 - 900,000
Unlimited holidays
Mental health day quarterly
Office designed for collaboration
+7
QA Engineer - Automation, API & Cloud Testing
QA Engineer - Automation, API & Cloud Testing

Invictus Capital • Cape Town

On-site
ZAR 500,000 - 700,000