AI Agent Engineer — POC Delivery & QA Specialist

Sarj AI; Riyadh; On-site; SAR 240,000 - 420,000; Full time

Job summary

Sarj AI in Riyadh seeks an Agent Engineer to design, build, and deploy AI agents that solve real-world problems. You will support Proof of Concept development, own end-to-end delivery of agent implementations, and interface with clients to gather requirements and report progress.

The role emphasizes QA, compliance, and collaboration with product and operations teams to improve prompts and workflows in a fast-growing startup.

Qualifications

• Basic understanding of software testing concepts and methodologies.
• Familiarity with testing tools or programming languages is a plus.
• Strong attention to detail and problem-solving skills.

Responsibilities

• Support the development of Proof of Concepts (POCs) for new client use cases, from scoping through to demo-ready delivery.
• Design and build AI agents using our platform, translating client requirements into functional agent workflows.
• Own end-to-end delivery of agent implementations — taking responsibility for timelines, quality, and outcomes.
• Interface with clients to gather requirements, present progress, answer questions, and manage expectations throughout the project lifecycle.
• Listen to recorded calls between AI agents and customers, evaluating each interaction for accuracy, tone, compliance, and customer experience.
• Score conversations against a defined quality rubric and document findings in our QA tracking system.
• Flag agent errors, hallucinations, missed customer cues, and policy or compliance issues for the team to address.
• Identify patterns and trends across calls — recurring failure modes, common customer questions, and opportunities to improve agent prompts and workflows.
• Partner with the Operations team to share feedback that informs agent training, prompt updates, and product improvements.
• Help refine and evolve the QA rubric and scoring guidelines as our agents grow and change.
• Contribute to weekly quality reports summarizing performance metrics, key issues, and recommended improvements.
• Occasionally review chat or text-based agent transcripts in addition to voice calls.

Skills

Software testing

QA tools

Attention to detail

Analytical skills

Arabic/English

Strong communication

Fast learner

Job description

Sarj AI in Riyadh seeks an Agent Engineer to design, build, and deploy AI agents that solve real-world problems. You will support Proof of Concept development, own end-to-end delivery of agent implementations, and interface with clients to gather requirements and report progress.

The role emphasizes QA, compliance, and collaboration with product and operations teams to improve prompts and workflows in a fast-growing startup.