AI Agent Engineer: Build & QA Real-World Agents

Sarj; Riyadh; On-site; SAR 120,000 - 180,000; Full time

Job summary

Sarj in Riyadh is seeking an Agent Engineer to design, build, and deploy AI agents that address real-world problems. You will work with engineering, product, and client-facing teams to deliver end-to-end agent solutions and support POC development.

You will own delivery timelines and quality, interface with clients to gather requirements and report progress, and review agent conversations for accuracy, tone, and compliance.

Qualifications

• Basic understanding of software testing concepts.
• Familiarity with testing tools or programming languages is a plus.
• Strong attention to detail and problem-solving skills.
• Excellent communication and analytical abilities.
• Eagerness to learn and adapt in a fast-paced environment.
• Ability to speak and write fluently in both Arabic & English.
• Must be based in Riyadh.

Responsibilities

• Support the development of Proof of Concepts (POCs) for new client use cases, from scoping through to demo-ready delivery.
• Design and build AI agents using our platform, translating client requirements into functional agent workflows.
• Own end-to-end delivery of agent implementations - taking responsibility for timelines, quality, and outcomes.
• Interface with clients to gather requirements, present progress, answer questions, and manage expectations throughout the project lifecycle.
• Listen to recorded calls between AI agents and customers, evaluating each interaction for accuracy, tone, compliance, and customer experience.
• Score conversations against a defined quality rubric and document findings in our QA tracking system.
• Flag agent errors, hallucinations, missed customer cues, and policy or compliance issues for the team to address.
• Identify patterns and trends across calls - recurring failure modes, common customer questions, and opportunities to improve agent prompts and workflows.
• Partner with the Operations team to share feedback that informs agent training, prompt updates, and product improvements.
• Help refine and evolve the QA rubric and scoring guidelines as our agents grow and change.
• Contribute to weekly quality reports summarizing performance metrics, key issues, and recommended improvements.
• Occasionally review chat or text-based agent transcripts in addition to voice calls.

Skills

Basic testing concepts

Testing tools familiarity

Attention to detail

Communication & analytical

Willingness to learn

Arabic & English fluency

Based in Riyadh

Job description

Sarj in Riyadh is seeking an Agent Engineer to design, build, and deploy AI agents that address real-world problems. You will work with engineering, product, and client-facing teams to deliver end-to-end agent solutions and support POC development.

You will own delivery timelines and quality, interface with clients to gather requirements and report progress, and review agent conversations for accuracy, tone, and compliance.