AI Agent Engineer — Build & Validate Conversational Agents

Sarj | سرج; Riyadh; On-site; SAR 180,000 - 300,000; Full time

Job summary

Sarj is seeking an Agent Engineer to design, build, and deploy AI agents solving real-world problems. You will support POC development, own end-to-end delivery, and interface directly with clients—gaining hands-on experience in a rapidly growing AI startup.

The role requires bilingual fluency (Arabic & English), strong attention to detail, and the ability to thrive in a fast-paced environment while based in Riyadh.

Qualifications

• Basic understanding of software testing concepts and methodologies.
• Familiarity with testing tools or programming languages is a plus.
• Strong attention to detail and problem-solving skills.
• Excellent communication and analytical abilities.
• Eagerness to learn and adapt in a fast-paced environment.
• Ability to speak and write fluently in both Arabic & English.
• Must be based in Riyadh.

Responsibilities

• Support the development of Proof of Concepts (POCs) for new client use cases, from scoping through to demo-ready delivery.
• Design and build AI agents using our platform, translating client requirements into functional agent workflows.
• Own end-to-end delivery of agent implementations — taking responsibility for timelines, quality, and outcomes.
• Interface with clients to gather requirements, present progress, answer questions, and manage expectations throughout the project lifecycle.
• Listen to recorded calls between AI agents and customers, evaluating each interaction for accuracy, tone, compliance, and customer experience.
• Score conversations against a defined quality rubric and document findings in our QA tracking system.
• Flag agent errors, hallucinations, missed customer cues, and policy or compliance issues for the team to address.
• Identify patterns and trends across calls — recurring failure modes, common customer questions, and opportunities to improve agent prompts and workflows.
• Partner with the Operations team to share feedback that informs agent training, prompt updates, and product improvements.
• Help refine and evolve the QA rubric and scoring guidelines as our agents grow and change.
• Contribute to weekly quality reports summarizing performance metrics, key issues, and recommended improvements.
• Occasionally review chat or text-based agent transcripts in addition to voice calls.

Skills

Software testing basics

Attention to detail

Communication

Analytical skills

Bilingual (Arabic & English)

Learning agility

Tools

Testing tools

Programming languages

Job description

Sarj is seeking an Agent Engineer to design, build, and deploy AI agents solving real-world problems. You will support POC development, own end-to-end delivery, and interface directly with clients—gaining hands-on experience in a rapidly growing AI startup.

The role requires bilingual fluency (Arabic & English), strong attention to detail, and the ability to thrive in a fast-paced environment while based in Riyadh.