AI & Automation QA Engineer (RPA, Power Platform)

The Focus Group

Sandton

On-site

ZAR 420,000 - 600,000

Full time

2 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Healthcare benefits

Flexible working arrangements

Job summary

The Focus Group is seeking a QA Tester to ensure quality, stability, and performance across the Digitisation & Automation portfolio, including RPA, Power Platform, AI Agents and Copilot, APIs and integrations. The role drives quality engineering, test automation, and continuous testing to deliver production-ready solutions compliant with security and regulatory requirements.

The ideal candidate will have 3-5 years of enterprise testing experience, expertise in AI-enabled solutions, and strong

Qualifications

3-5 years of experience testing enterprise solutions.
Experience testing automation, workflow, Power Platform, APIs, and integrations.
Exposure to AI-enabled solutions, Generative AI agents, chatbots, or Copilot solutions is advantageous.

Responsibilities

Develop test strategies, test plans, test cases, and test scripts.
Define test coverage and acceptance criteria for AI, automation, and digital solutions.
Implement quality engineering throughout the development lifecycle.
Ensure traceability between requirements, tests, defects, and releases.
Support Agile teams through continuous testing practices.
Test attended and unattended RPA and Bot solutions.
Validate automated workflows and end-to-end process automation.
Test Power Apps, Power Automate flows, Power Pages, custom connectors, and Dataverse integrations.
Test Microsoft Copilot Studio, AI Agents, Azure AI Foundry, conversational AI, and Generative AI-enabled applications.
Validate APIs, web services, enterprise integrations, data flows, authentication, and security controls.
Validate AI responses for accuracy, relevance, consistency, usability, and correct execution of prompts and instructions.
Test guardrails, safety controls, response boundaries, escalation mechanisms, and responsible AI controls.
Identify hallucinations, incorrect outputs, edge cases, and exception scenarios.
Assess response reliability, repeatability, and compliance with business rules.
Perform regression testing after prompt, model, configuration, or release changes.
Confirm solution stability and verify that existing functionality has not degraded.
Design, develop, and maintain automated test suites and regression packs.
Implement continuous testing practices and support CI/CD quality gates.
Drive shift-left testing and automated quality controls across solutions.
Build reusable test assets, scripts, and frameworks.
Log, track, and manage defects throughout the development lifecycle.
Support root-cause analysis and defect resolution.
Monitor quality metrics and report testing progress.
Participate in release readiness and go-live assessments.
Perform security and role-based access testing.
Conduct performance, load, stress, and resilience testing where applicable.
Validate data privacy, security controls, and business continuity requirements.