Ai Principal Engineer

Mco (Mycomplianceoffice); Cape Town; On-site; ZAR 900 000 - 1 200 000; Full time

Job summary

A leading compliance solutions provider in South Africa is seeking an accomplished AI Principal Engineer to lead the design, development, and optimization of advanced AI and machine learning solutions. The ideal candidate will have a proven track record in building LLM applications, deep expertise in RAG, and a strategic mindset to drive innovation. This is a full-time role that involves mentoring teams and ensuring compliance with ethical AI standards.

Qualifications

• Experience developing enterprise-scale systems.
• Proven experience developing and delivering LLM applications.
• Expertise in RAG solutions, vector search, and embedding techniques.
• Advanced proficiency in Python, clean and maintainable coding.
• Solid understanding of database technologies (RDBMS and non-relational).
• Exceptional problem-solving abilities.

Responsibilities

• Design and maintain LLM-based applications.
• Optimize AI models for performance and reliability.
• Build data pipelines for AI/ML workflows.
• Lead and mentor AI engineering teams.
• Champion responsible AI practices.

Skills

Python programming

Large Language Model applications

Retrieval-Augmented Generation

Data pipelines

AI ethics and compliance

Collaboration and communication

Tools

Git

Snowflake

Job description

About the Role: We are seeking an accomplished AI Principal Engineer to lead the design, development, and optimisation of advanced AI and machine learning solutions.

The ideal candidate will have a proven track record in building and deploying Large Language Model (LLM) applications at scale, with deep expertise in Retrieval‑Augmented Generation (RAG), vector search, embeddings, and cloud‑based MLOps practices. This role requires a strategic thinker who can set technical direction, drive innovation, and ensure alignment with organisational goals.

Responsibilities

• Design, develop, and maintain LLM‑based application components across multiple projects, with a strong emphasis on Python programming.
• Optimise AI and machine learning models for performance, cost, and reliability at scale.
• Build and maintain data pipelines and backend interfaces to support AI/ML workflows, leveraging tools such as Python and Snowflake where appropriate.
• Set the technical direction for AI engineering, ensuring alignment with organisational goals and technology roadmaps.
• Lead and mentor AI engineering teams, fostering a culture of innovation, technical excellence, and knowledge sharing.
• Collaborate with product managers, compliance teams, and business stakeholders to define and deliver impactful AI solutions.
• Champion responsible AI practices, ensuring solutions are ethical, explainable, and compliant with regulatory and organisational standards.
• Evaluate emerging AI technologies and frameworks, recommending adoption where they add value.
• Troubleshoot, debug, and upgrade AI/ML systems to ensure high performance and responsiveness.
• Participate in code reviews to uphold high‑quality coding standards and promote knowledge sharing within the team.

Qualifications

• Years of experience developing enterprise‑scale systems.
• Proven experience developing and delivering LLM applications.
• Demonstrable experience working with responsible AI frameworks.
• Demonstrated expertise in designing and deploying RAG solutions, vector search, and embedding techniques.
• Advanced proficiency in Python, with a track record of writing clean, maintainable, and efficient code.
• Solid understanding of database technologies, including relational (RDBMS) and non‑relational systems, with experience in data migration and optimisation.
• Proficiency in using modern code versioning tools such as Git.
• Exceptional problem‑solving abilities and a strong capacity to deliver results in a fast‑paced, dynamic environment.
• Excellent communication and collaboration skills, with experience working closely with developers, product owners, and product managers.
• Experience mentoring team members and contributing to the development of best practices within AI engineering teams.

About MCO (MCO Word here): MCO is a global leader dedicated to empowering Financial Services firms to manage compliance programs with ease and efficiency. Our mission is to foster a fair, transparent, and trusted financial environment worldwide by helping organizations meet their regulatory obligations. Headquartered in Dublin, MCO has an international footprint with offices in London, Singapore, Hyderabad, New York, Chicago, Fort Worth, Switzerland, South Africa, Slovenia, and the UAE.