AI Agent Harness Engineer — Build Orchestration & Testing

Mind Detect; Wes-Kaap; On-site; ZAR 900,000 - 1,500,000; Full time

Benefits offered by this job

Equity in the business

Generous leave

Medical aid contribution

Advanced equipment/technology

Job summary

A technology recruitment firm based in Cape Town is seeking an Agentic Harness Engineer to design and implement tools for AI agents. This hands-on role involves building frameworks to monitor AI performance, collaborating with engineers, and contributing to architecture discussions. Ideal candidates will have a Bachelor's in Computer Science and over 4 years in software engineering. The position offers a generous remuneration package and promotes a great work-life balance.

Qualifications

• 4+ years experience in software engineering, preferably in full-stack or platform engineering.
• Familiarity with LLM-based systems, AI agents, or autonomous workflows.
• Experience with AI agent frameworks and LLM evaluation frameworks.

Responsibilities

• Design and build agent harness frameworks to test and monitor AI agents.
• Develop evaluation pipelines and benchmarking systems for agent performance.
• Diagnose and troubleshoot agent failures and system issues.

Skills

Software engineering best practices

Building testing frameworks

Genuine enthusiasm for agentic AI

Comfort operating as sole contributor

Education

Bachelor’s degree in Computer Science, AI, Software Engineering

Tools

Kubernetes

Cloud infrastructure

Observability tools for AI systems

Job description

A technology recruitment firm based in Cape Town is seeking an Agentic Harness Engineer to design and implement tools for AI agents. This hands-on role involves building frameworks to monitor AI performance, collaborating with engineers, and contributing to architecture discussions. Ideal candidates will have a Bachelor's in Computer Science and over 4 years in software engineering. The position offers a generous remuneration package and promotes a great work-life balance.