Agent Engineer

Sarj AI; Riyadh; Sur place; SAR 240 000 - 420 000; Plein temps

Résumé du poste

Sarj AI in Riyadh seeks an Agent Engineer to design, build, and deploy AI agents that solve real-world problems. You will support Proof of Concept development, own end-to-end delivery of agent implementations, and interface with clients to gather requirements and report progress.

The role emphasizes QA, compliance, and collaboration with product and operations teams to improve prompts and workflows in a fast-growing startup.

Qualifications

• Basic understanding of software testing concepts and methodologies.
• Familiarity with testing tools or programming languages is a plus.
• Strong attention to detail and problem-solving skills.

Responsabilités

• Support the development of Proof of Concepts (POCs) for new client use cases, from scoping through to demo-ready delivery.
• Design and build AI agents using our platform, translating client requirements into functional agent workflows.
• Own end-to-end delivery of agent implementations — taking responsibility for timelines, quality, and outcomes.
• Interface with clients to gather requirements, present progress, answer questions, and manage expectations throughout the project lifecycle.
• Listen to recorded calls between AI agents and customers, evaluating each interaction for accuracy, tone, compliance, and customer experience.
• Score conversations against a defined quality rubric and document findings in our QA tracking system.
• Flag agent errors, hallucinations, missed customer cues, and policy or compliance issues for the team to address.
• Identify patterns and trends across calls — recurring failure modes, common customer questions, and opportunities to improve agent prompts and workflows.
• Partner with the Operations team to share feedback that informs agent training, prompt updates, and product improvements.
• Help refine and evolve the QA rubric and scoring guidelines as our agents grow and change.
• Contribute to weekly quality reports summarizing performance metrics, key issues, and recommended improvements.
• Occasionally review chat or text-based agent transcripts in addition to voice calls.

Connaissances

Software testing

QA tools

Attention to detail

Analytical skills

Arabic/English

Strong communication

Fast learner

Description du poste

About Us

Built with in KSA and leveraging Silicon Valley expertise, we’re creating innovative solutions in the realm of Voice AI and AI agents. As we continue our rapid growth trajectory in an exciting and dynamic market, we’re looking for A-players to join our team.

Role Overview

As an Agent Engineer, you will work closely with our engineering, product, and client-facing teams to design, build, and deploy AI agents that solve real-world problems. You'll support Proof of Concept (POC) development, own the end-to-end delivery of agent implementations, and interface directly with clients — gaining hands-on experience in one of the most in-demand areas of modern AI.

Key Responsibilities

• Support the development of Proof of Concepts (POCs) for new client use cases, from scoping through to demo-ready delivery.

• Design and build AI agents using our platform, translating client requirements into functional agent workflows.

• Own end-to-end delivery of agent implementations — taking responsibility for timelines, quality, and outcomes.

• Interface with clients to gather requirements, present progress, answer questions, and manage expectations throughout the project lifecycle.

• Listen to recorded calls between AI agents and customers, evaluating each interaction for accuracy, tone, compliance, and customer experience.

• Score conversations against a defined quality rubric and document findings in our QA tracking system.

• Flag agent errors, hallucinations, missed customer cues, and policy or compliance issues for the team to address.

• Identify patterns and trends across calls — recurring failure modes, common customer questions, and opportunities to improve agent prompts and workflows.

• Partner with the Operations team to share feedback that informs agent training, prompt updates, and product improvements.

• Help refine and evolve the QA rubric and scoring guidelines as our agents grow and change.

• Contribute to weekly quality reports summarizing performance metrics, key issues, and recommended improvements.

• Occasionally review chat or text-based agent transcripts in addition to voice calls.

Requirements

• Basic understanding of software testing concepts and methodologies

• Familiarity with testing tools or programming languages is a plus

• Strong attention to detail and problem-solving skills

• Excellent communication and analytical abilities

• Eagerness to learn and adapt in a fast-paced environment

• Ability to speak and write fluently in both Arabic & English

• Must be based in Riyadh

Why Join Us?

• Opportunity to be part of a high-growth, innovative tech start-up

• Collaborative, mission-driven culture

• Hands-on experience working on impactful AI products