Lead AI LLM Engineer – Sandton – R1.5m PA

e-Merge IT Recruitment; Sandton; On-site; ZAR 1,350,000 - 1,650,000; Full time

Job summary

e-Merge IT Recruitment seeks a hands-on Lead AI LLM Engineer to shape and build the next generation of AI-powered and conversational solutions in production. You'll own major AI initiatives, guide architecture, mentor engineers in a small Agile team, and collaborate with the Head of AI on priorities while delivering production-ready services on Azure.

Join a forward-thinking tech environment in Sandton, offering challenging work, scale, and real impact on AI systems across voice agents,

Qualifications

• 7+ years of software engineering experience.
• 3+ years shipping LLM/speech solutions into production.
• Deep experience in two areas at least: voice agents, speech pipelines, LLM evaluation, multi-agent/tool-calling, prompt design.
• Proven experience leading engineers within a small Agile team.

Responsibilities

• Own end-to-end delivery across voice agents, speech/LLM QA, post-call intelligence and text-channel agents.
• Partner with Head of AI on architecture, priorities and production risk.
• Design and build production AI services on Azure.
• Lead prompt and agent design.
• Build LLM evaluation and regression frameworks.
• Improve reliability across latency, cost, failures and observability.
• Mentor engineers through design reviews and code reviews.
• Collaborate with platform teams to keep AI products aligned.
• Work with Azure DevOps on deployment and GPU/LLM cost optimisation.

Skills

Software engineering

LLM deployment

Voice agents

Speech pipelines

LLM evaluation

Multi-agent & tool-calling

Prompt design

Team leadership

Tools

Azure

CI/CD

Observability

GPU cost optimisation

Job description

BUILD AI THAT DOESN’T JUST TALK! IT DELIVERS.

If you’re a hands-on AI Engineer who wants to take ownership of real-world AI systems and help move them from “this is cool” to “this is running in production”, this could be your next challenge.

We’re looking for a Lead AI LLM Engineer to join a forward-thinking technology environment where you’ll help shape and build the next generation of AI-powered and conversational solutions.

This is a hands-on leadership role. You’ll still be close to the technology while helping guide engineers, make architecture decisions and turn ambitious AI ideas into scalable, reliable production systems.

THIS IS WHERE IT GETS INTERESTING

You’ll work across some seriously exciting areas:

LLMs | Voice Agents | Speech AI | AI Evaluation | Multi-Agent Systems | Tool Calling | AI-Assisted Development

You could be working on everything from voice agents and speech pipelines to post-call intelligence, conversational AI and automated QA.

WHAT YOU’LL BRING

We’re looking for someone with:

• 7+ years’ software engineering experience
• 3+ years’ experience shipping LLM and/or speech + LLM solutions into production
• Deep experience in at least two of the following:
• Voice / conversational agents
• Speech pipelines, including STT, diarisation and VAD
• LLM evaluation
• Multi-agent and tool-calling systems
• Experience designing prompts for multi-step, compliance-sensitive workflows
• Proven experience leading and mentoring engineers within a small Agile team

NICE TO HAVE:

Experience with:

• Claude, Cursor or other AI coding assistants
• Voice platforms and STT/TTS vendor optimisation
• Whisper, diarisation, vLLM, OpenAI Batch and structured outputs
• Contact centre, collections or BPO environments
• Application monitoring and observability
• CI/CD and production operations
• WhatsApp and email-based conversational bots

WHAT YOU’LL ACTUALLY BE DOING:

You’ll take ownership of major AI initiatives and help turn them into production-ready systems.

That includes:

• Owning end-to-end delivery across areas such as voice agents, speech/LLM QA, post-call intelligence and text-channel agents
• Partnering with the Head of AI on architecture, priorities and production risk
• Designing and building production AI services on Azure
• Leading prompt and agent design
• Building LLM evaluation and regression frameworks
• Improving reliability across latency, cost, failures and observability
• Driving quality and accuracy across post-call intelligence solutions
• Mentoring engineers through design reviews, pairing and code reviews
• Working with platform teams to ensure AI products, dashboards and runtime environments remain aligned
• Collaborating with Azure DevOps around deployment, infrastructure and GPU/LLM cost optimisation

THE PERSON WE’R LOOKING FOR:

You’re not just interested in AI.

You’re interested in building AI that works.

You understand that getting an LLM demo running is one thing.

Getting an AI system to operate reliably, securely, efficiently and at scale in production is something else entirely.

You’re technically strong, commercially minded and comfortable taking ownership.

You can lead from the front, mentor the team and still jump into the code when the problem gets difficult.

If you want to help build the future of conversational AI — this is worth a conversation.

THE DETAILS

Reference: GZ61522

Type: Permanent

Salary: R1.5m per annum, negotiable based on experience and ability

Contact Garth:

[e-mail]

011 463 3633

#AIEngineer #LLMEngineer #ArtificialIntelligence #GenerativeAI #LLM #AIAgents #AgenticAI #ConversationalAI #VoiceAI #SpeechAI #Python #Azure #MachineLearning #AIJobs #TechJobs #SandtonJobs #JohannesburgJobs #SouthAfricaJobs #Hiring