AI Platform Engineer Applied AI

Jobgether; Remote; ZAR 2 085 000 - 2 246 000; Full time

Job summary

A technology firm specializing in AI is looking for an AI Platform Engineer in South Africa. The role involves designing and implementing infrastructure for AI systems, focusing on production evaluation and observability tools. The ideal candidate should have experience with AI systems, proficiency in Python, and the ability to innovate in a fully remote setup. The company offers attractive benefits including a competitive salary, flexible work arrangements, and generous PTO.

Benefits

Competitive salary

Fully remote work

35 days of PTO annually

Comprehensive medical coverage

Parental leave

Home office stipend

Annual company retreats

Qualifications

• Proven experience with AI systems in production, including RAG pipelines and LLM applications.
• Strong proficiency in Python and willingness to learn Ruby on Rails.
• Deep understanding of re-ranking, retrieval, and context management.

Responsibilities

• Build evaluation infrastructure for AI system metrics.
• Develop observability tools and dashboards.
• Diagnose performance gaps and analyze usage data.

Skills

Building and evaluating AI systems

Proficiency in Python

Ability to work with Ruby on Rails

Strength in experimentation and data analysis

Aligning with company values

Job description

This position is posted by Jobgether on behalf of a partner company. We are currently looking for an AI Platform Engineer, Applied AI in South Africa.

We are seeking a highly skilled AI Platform Engineer to design and implement infrastructure that enables large-scale AI systems to operate reliably and efficiently. In this role, you will focus on production AI systems, building evaluation frameworks, observability tooling, and diagnostic infrastructure to measure and improve system performance. You will collaborate with engineers across the organization to identify gaps, prototype solutions, and implement improvements that enhance AI-driven features. The ideal candidate thrives in a fast-paced, fully remote environment, is comfortable navigating ambiguity, and has a passion for optimizing AI systems that impact millions of users. This is a high-ownership role with significant influence on how AI features are monitored, evaluated, and improved.

Accountabilities

• Build evaluation infrastructure to measure AI system speed, accuracy, and reliability, both offline and in production.
• Develop observability tools and dashboards that surface quality metrics and track improvements over time.
• Diagnose performance gaps across retrieval, ranking, prompting, and other AI workflows.
• Prototype and validate improvements to AI pipelines, including RAG pipelines, chunking strategies, retrieval methods, and re-ranking approaches.
• Analyze usage data to identify opportunities for enhancement and new AI features.
• Collaborate with engineers to ensure production changes improven
• Stay current with cutting-edge AI research, techniques, and tools to inform platform improvements.

Requirements

• Proven experience building and evaluating AI systems in production, including RAG pipelines, retrieval/search systems, and LLM-powered applications.
• Strong proficiency in Python for prototyping and experimentation.
• Willingness to learn and work with Ruby on Rails for integrating with production systems.
• Expertise in AI infrastructure, evaluation pipelines, observability toolingn
• Deep understanding of RAG architecture, embeddings, retrieval, re-ranking, and context management.
• Strong experimentation and data analysis skills, including designing A/B tests, measuring results, and iterating quickly.
• Ability to work autonomously in a fast-paced, dynamic environment while collaborating effectively with a team.
• Strong alignment with company values and CEFR Level C2 / ILR Level 5 proficiency in English.

Benefits

• Competitive U.S.-benchmarked salary range: $130,000 – $140,000 USD per year, with annual reviews and potential equity and bonus opportunities.
• Fully remote work with autonomy and focus on outcomes.
• 35 days of PTO annually, plus paid sabbatical after 5 years.
• Comprehensive medical coverage for employees and families or reimbursement options.
• Parental leave for expanding families.
• Home office stipend and professional learning & development support.
• Annual company retreats at international locations.
• Opportunity to work on high-impact AI infrastructure that shapes the user experience for millions of customers.