Software Quality Assurance Engineer - AI Agents

Lucidya | لوسيديا; Riyadh; On-site; SAR 80,000 - 100,000; Full time

Job summary

A rapidly growing SaaS company in Saudi Arabia is seeking a Software Quality Assurance Engineer to ensure AI agents meet high quality standards. The role involves both manual and automated testing, working closely with product and engineering teams. The ideal candidate should have 2-5 years of QA experience, strong automation skills, and the ability to test APIs and backend workflows. This is an exciting opportunity to shape quality for AI products used by leading enterprises in the MENA region.

Benefits

Collaborative culture

Opportunity for learning

Involvement in high-impact projects

Qualifications

• 2-5 years of experience in QA engineering (manual + automation).
• Programming/scripting experience in Python, JavaScript, or Java.
• Automation experience with Playwright is a strong plus.

Responsibilities

• Own quality across AI-driven workflows and agent-based systems.
• Partner with teams to define acceptance criteria and test scenarios.
• Execute manual and exploratory testing for workflows and integrations.

Skills

Strong QA Fundamentals

Practical Automation Experience

API & Backend Testing Competency

High Adaptability

Strong Communication & Ownership

Education

Bachelor's degree in Computer Science or Engineering

Tools

Playwright

Git

Jira

Jenkins

Job description

About Lucidya

Lucidya is a fast-growing SaaS company transforming customer experience across the MENA region through AI-powered solutions built for the Arabic-speaking world.

AI Agents Business Unit

Our AI Agents business unit is focused on building and deploying intelligent, enterprise-grade AI agents that automate, assist, and augment customer-facing and operational workflows. These AI agents operate across complex environments (integrating with CX platforms, CRMs, contact centers, and internal systems) where reliability, accuracy, security, and trust are critical.

Software Quality Assurance Engineer

As we scale this new business unit, we are hiring a Software Quality Assurance Engineer to ensure our AI agents meet the highest standards of quality, performance, and enterprise readiness.

Why We're Hiring

• Own quality across AI-driven workflows and agent-based systems
• Balance manual, exploratory, and automated testing
• Validate complex backend and API integrations
• Help define quality standards for AI agent deployments at enterprise scale

What You'll Do (Key Responsibilities)

AI Agent Quality & Test Strategy

• Partner with product, AI, data, and engineering teams early ("shift-left") to define acceptance criteria, test scenarios, and quality benchmarks for AI agents.
• Participate in requirement discussions to assess testability, risks, and edge cases specific to AI-driven behavior.
• Help define what "good quality" means for AI agents (reliability, fallback behavior, latency, error handling, consistency).

Manual & Exploratory Testing

• Execute manual and exploratory testing for AI agent workflows, integrations, and end-to-end scenarios.
• Validate agent behavior across happy paths, edge cases, failure states, and real-world enterprise use cases.
• Conduct regression testing across multiple agents, channels, and environments.
• Validate cross-browser and cross-device behavior for agent-facing UIs (web and mobile where applicable).

Automation & CI/CD

• Design, build, and maintain automated test suites (UI, API, end-to-end), with Playwright preferred.
• Extend automation frameworks to support agent workflows, conversational paths, and backend orchestration.
• Integrate automated tests into CI/CD pipelines and collaborate with DevOps to ensure reliable releases.

API, Backend & Non-Functional Testing

• Perform deep API and backend workflow testing to ensure AI agents interact correctly with internal and external systems.
• Support performance, load, and reliability testing—especially for concurrent agent usage and peak enterprise loads.
• Assist in security testing initiatives for AI agent integrations and data flows.
• Support test data strategies across environments, including realistic AI scenarios.

Quality Governance & Reporting

• Log, track, and triage defects; collaborate closely with engineers and AI teams to reproduce and resolve issues.
• Provide release readiness assessments, risk analysis, and defect trend reporting for agent deployments.
• Advocate for usability, accessibility, reliability, and enterprise-grade quality across the AI Agents portfolio.

Continuous Improvement

• Contribute to QA best practices, standards, and documentation tailored to AI agent systems.
• Help evolve testing approaches for AI-driven products (e.g., exploratory heuristics, scenario-based testing).
• Stay current with modern QA trends, including AI-assisted testing, automation improvements, and cloud testing tools.

What You Must Have (Non-Negotiables)

• Strong QA Fundamentals – Solid manual and exploratory testing skills, strong defect analysis, and the ability to identify edge cases and risks.
• Practical Automation Experience – Hands‑on experience building, maintaining, and troubleshooting automated tests (Playwright preferred).
• API & Backend Testing Competency – Ability to test APIs and validate backend flows thoroughly.
• High Adaptability – Comfortable working across manual, automation, performance/security, requirement discussions, and shifting priorities.
• Strong Communication & Ownership – Clear communicator, proactive collaborator, takes ownership of quality, and willingness to participate in occasional rotational weekend support.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field
• 2-5 years of experience in QA engineering (manual + automation)
• Programming/scripting experience in Python, JavaScript, or Java
• Automation experience with Playwright is a strong plus
• Proven experience in API testing (required)
• Experience with Git, CI tools (Jenkins, GitHub Actions, GitLab CI), and defect tracking tools like Jira
• Exposure to performance/load/security testing tools (JMeter, Locust, OWASP ZAP) is a plus
• ISTQB or equivalent certification is a plus
• Strong English communication skills
• Strong organisational and time-management skills across multiple projects
• Ability to work independently with moderate supervision
• Comfortable giving and receiving structured feedback
• Willingness to join infrequent rotational weekend support for critical issues
• Adaptable to changing product priorities and organisational structures (pods/squads or QA‑as‑a‑service)

Why Join Lucidya - AI Agents

• Be part of building a brand-new AI Agents business unit from the ground up
• High-impact role shaping how enterprise AI quality is defined and measured
• Exposure to modern AI-driven systems, complex integrations, and advanced QA tooling
• Collaborative, ownership‑driven culture focused on learning and continuous improvement
• Opportunity to influence quality standards for AI products used by leading enterprises across MENA