QA Automation Engineer - AI & LLM Testing

ZappiStore

Cape Town

On-site

ZAR 800,000 - 900,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Unlimited holidays
Mental health day each quarter
Office designed for collaboration
Private medical healthcare cover
Medical Aid
Group risk, life & disability
Wellbeing benefits (yoga, therapists)
Paid parking in Cape Town
Free coffee, lunches and snacks
Career development allowances

Job summary

Zappi is seeking a Software Development Engineer in Test to join the Engineering team in Cape Town. You will design, build and maintain automated test frameworks for APIs, GUI and performance, leveraging Playwright TS and cutting-edge agentic testing approaches.

You will collaborate with Product, Design and other engineering squads to improve test coverage, validate data pipelines and integrate tests into CI pipelines, while mentoring peers and driving quality across the platform.

Qualifications

  • Experience designing automated test suites for APIs, GUI and performance.
  • Hands-on with agentic engineering and LLM-powered testing approaches.
  • Strong QA discipline across SDLC and release cycles.
  • Ability to collaborate with product and engineering teams.
  • Familiarity with cloud platforms and CI/CD practices.

Responsibilities

  • Design, build and maintain automated test frameworks for APIs, GUI and performance.
  • Apply agentic engineering to testing workflows and analyses.
  • Develop and run LLM evaluations and test agent-based workflows.
  • Clarify requirements with engineers and product teams early in development.
  • Test from the customer perspective and automate repetitive checks.
  • Validate data integrity and data pipelines across systems.
  • Integrate tests into CI pipelines and improve feedback loops.

Skills

Test automation
Agentic engineering
LLM evaluation
QA methodologies
Communicative teamwork

Tools

Playwright
AWS
CI/CD pipelines
LLM tooling

Job description

Zappi is seeking a Software Development Engineer in Test to join the Engineering team in Cape Town. You will design, build and maintain automated test frameworks for APIs, GUI and performance, leveraging Playwright TS and cutting-edge agentic testing approaches.

You will collaborate with Product, Design and other engineering squads to improve test coverage, validate data pipelines and integrate tests into CI pipelines, while mentoring peers and driving quality across the platform.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Quality Engineer – AI & Agentic Testing
Quality Engineer – AI & Agentic Testing

Zappi • Cape Town

On-site
ZAR 800,000 - 900,000
Unlimited holidays
Mental health day quarterly
Office designed for collaboration
+7
Software Quality Engineer - Automation & CI/CD Lead
Software Quality Engineer - Automation & CI/CD Lead

ATS Client • Cape Town

On-site
ZAR 420,000 - 640,000
Platform Engineering Lead - Infra & AI
Platform Engineering Lead - Infra & AI

ZappiStore • Cape Town

On-site
ZAR 1,300,000 - 1,600,000
Unlimited holidays
Mental health days
Private medical healthcare cover
+2
Platform Engineering Lead: AI Infra & DevEx (Cape Town)
Platform Engineering Lead: AI Infra & DevEx (Cape Town)

ZappiStore • Cape Town

On-site
ZAR 1,300,000 - 1,600,000
Unlimited holidays
Mental health days
Office facilities
+7
Senior QA Engineer: UI/API Automation in CI/CD
Senior QA Engineer: UI/API Automation in CI/CD

QoT Solutions • Cape Town

Hybrid
ZAR 420,000 - 640,000
Senior Platform Engineering Manager — AI Infra Leader
Senior Platform Engineering Manager — AI Infra Leader

Zappi • Cape Town

On-site
ZAR 1,300,000 - 1,600,000
Unlimited holidays
Private medical healthcare cover
Medical Aid
+2
QA Engineer - Automation, API & Cloud Testing
QA Engineer - Automation, API & Cloud Testing

Invictus Capital • Cape Town

On-site
ZAR 500,000 - 700,000
QA Automation Engineer — API, UI & CI/CD Expert
QA Automation Engineer — API, UI & CI/CD Expert

Indsafri • South Africa

On-site
ZAR 420,000 - 780,000
Automation QA Engineer: API & Microservices
Automation QA Engineer: API & Microservices

Boardroom Appointments • Johannesburg

On-site
ZAR 500,000 - 800,000
Senior Quality Engineer: Test Automation & Performance
Senior Quality Engineer: Test Automation & Performance

Zensar Technologies • Wes-Kaap

On-site
ZAR 600,000 - 900,000