AI / LLM Ops Engineer

Elixirr Digital; Cape Town; Remote; ZAR 60,000 - 90,000; Full time

Job summary

A forward-thinking tech company in Cape Town is seeking an AI / LLM Ops Engineer who will design, build, and maintain LLM and agent pipelines. The ideal candidate will have strong ML Ops experience, hands-on skills with LLMs, and a solid understanding of cloud infrastructure. Join us to drive AI innovation and work on transformative projects for global clients, all within a collaborative culture.

Benefits

Performance bonus

Flexible working hours

Learning and development budget

Employee stock options

Qualifications

• Strong experience in ML Ops, LLM Ops, or AI Ops roles.
• Hands-on experience with fine-tuning and deploying LLMs.
• Practical knowledge of agent frameworks and tools.

Responsibilities

• Design and maintain LLM/agent pipelines.
• Monitor model performance for reliability.
• Ensure infrastructure scalability in cloud environments.

Skills

ML Ops knowledge

Experience with LLMs

Cloud infrastructure understanding

Scripting in Python

Agent frameworks experience

Problem-solving skills

Tools

Docker

Kubernetes

LangChain

Pinecone

Weaviate

Job description

Overview

Do you want to help shape the future of intelligent systems, focusing on LLMs and agents? Do you enjoy turning cutting-edge research into production-grade AI solutions? Then join Elixirr Digital as our next AI / LLM Ops Engineer!

Join Elixirr Digital as an AI / LLM Ops Engineer, where you will drive innovation and help shape the future of intelligent systems for clients across industries like banking, insurance, healthcare, telecommunications, consumer goods, and more. We\'re looking for proactive self-starters who are constantly reading research, applying it, and using AI to improve their processes, fully embracing the technology.

At Elixirr Digital, we’ve been early adopters of generative AI, working across open-source and foundation models. From building agents that automate internal workflows to deploying LLM-powered tools that delight users, we believe in pushing boundaries, applying emerging tech, and delivering real impact.

If you’re excited to work at the forefront of generative AI, helping enterprises transform from the inside out, we want to hear from you. Let’s build the future of AI together!

What will you be doing as an AI / LLM Ops Engineer at Elixirr Digital?

• Design, build, and maintain LLM / agent pipelines : from prototyping to fine-tuning, deployment, monitoring, and scaling.
• Design and deploy agentic systems and orchestration frameworks leveraging LangChain, AutoGen, or other agent-oriented architectures to enable scalable, reliable automation.
• Implement and operationalize RAG pipelines including document ingestion, embedding generation, context chunking, and vector database integration for optimized retrieval and knowledge management.
• Monitor model performance (latency, accuracy, drift), ensure reliability and robustness.
• Ensure security, and infrastructure scalability (cloud / GPU / TPU etc.).
• Innovate : explore research, new frameworks, agentic capabilities; prototype internal tools; help improve process & tooling.

Competencies and skillset we expect you to have to successfully perform your job :

• Strong experience in ML Ops / LLM Ops / AI Ops or similar roles.
• Hands-on with LLMs : fine-tuning, deployment, building agentic solutions.
• Practical experience with agent frameworks / tools (e.g., LangChain, AutoGen, Crew, Swarm, etc.).
• Solid understanding of cloud infrastructure, containerization (Docker, Kubernetes), orchestration, CI / CD pipelines.
• Proven track record of optimizing model performance, managing latency, monitoring, drift detection, logging (Ragas, DeepEval, LangSmith).
• Comfortable scripting / programming in Python (plus automation tooling).
• Experience with multi-modal agents or models (text, image, audio).
• Prior work with vector databases (Pinecone, Weaviate, etc.), retrieval or knowledge store architectures.

We could be a perfect fit if you are :

• Passionate about technology. You anticipate, recognize, and resolve technical problems using a variety of specialized tools for application development and support.
• Independent. You are a self-motivated and ambitious individual, capable of managing multiple responsibilities effectively.
• Problem-solver. You think creatively and find solutions to complex challenges.
• Creative and outside-the-box thinker. You look beyond blog posts and whitepapers, competitions, and even state-of-the-art benchmarks to solve real-world problems.
• Communicator. Strong verbal and written communication skills are essential to ensure effective collaboration and timely delivery of results within the team.
• Proficient in English. We work across continents in a global environment, so fluent English, both written and spoken is a must.

Why join Elixirr Digital?

• Global Impact : Work with top-tier clients across industries, solving real-world challenges with transformative AI solutions.
• Cutting-Edge Innovation : Develop and deploy AI tools and platforms that redefine what’s possible in enterprise AI.
• Collaborative Culture : Join a team of innovators passionate about advancing AI while fostering a collaborative, inclusive environment.
• Diverse Projects : Tackle a wide range of AI applications—from NLP to reinforcement learning—for use cases as varied as field support for telecom workers and optimizing customer workflows in banks.

Why is Elixirr Digital the right next step for you?

From working with cutting-edge technologies to solving complex challenges for global clients, we make sure your work matters. And while you’re building great things, we’re here to support you.

Compensation & Equity :

• Individually tailored benefits package
• Performance bonus
• Employee Stock Options Grant
• Employee Share Purchase Plan (ESPP)
• Competitive compensation

Flexibility & Balance :

• Flexible working hours and remote work
• Multi-sport card
• Full medical checkup

Projects & Tools :

• Big clients and interesting projects
• Cutting-edge technologies

Learning & Growth :

• Learning and development budget
• Growth and development opportunities

People-Centered Perks :

• Referral bonus
• Top performer bonus
• Anniversary bonus

We don’t just offer a job - we create space for you to grow, thrive, and be recognized.

Intrigued?Apply now!