Lead AI Platform Engineer - Fully Remote & Flexible

Jobgether SRL; South Africa; Remote; ZAR 2,388,000 - 3,231,000; Full time

Benefits offered by this job

Fully remote work environment

Equity & refresh grants

35 days paid time off

Job summary

Jobgether SRL seeks a Lead Engineer, AI Platform for a fully remote, async environment in South Africa. You will lead the engineering foundation behind reliable AI-powered features, building evaluation frameworks, observability tooling, and diagnostic infrastructure for production AI agents.

You will guide experiments across models, prompts, and architectures while collaborating with AI Core teams to improve quality and reduce latency and cost.

Qualifications

• 7+ years of experience building and shipping production software with AI-powered agents.
• Experience with tool-using AI systems involving multiple tools and sub-agents.
• Strong track record of shipped software and measurable reliability.
• Proficiency in Ruby on Rails and/or Python; ability to learn new tech quickly.
• Experience building evaluation/observability infrastructure for ML/AI systems.
• Familiarity with Braintrust, LangSmith, or similar evaluation frameworks.
• Ability to design datasets, annotation workflows, or labeling pipelines for ML evaluation.
• Leadership capabilities with hands-on engineering balance.

Responsibilities

• Design, build, and own evaluation infrastructure for AI agents across multi-turn conversations.
• Develop observability and diagnostic capabilities to locate quality issues in AI workflows.
• Investigate failures and define priorities for AI engineering teams.
• Expand datasets through annotation, AI-generated content, and simulated chats.
• Create structured experimentation for prompts, models, and agent harnesses.
• Optimize AI systems for cost, latency, and reliability.

Skills

LLM-powered agents

Ruby on Rails

Python

Observability

Experimentation

Technical leadership

People management

English proficiency

Tools

Braintrust

LangSmith

CI/CD

Job description

Jobgether SRL seeks a Lead Engineer, AI Platform for a fully remote, async environment in South Africa. You will lead the engineering foundation behind reliable AI-powered features, building evaluation frameworks, observability tooling, and diagnostic infrastructure for production AI agents.

You will guide experiments across models, prompts, and architectures while collaborating with AI Core teams to improve quality and reduce latency and cost.