Data Engineer: AI/LLM & Modern Data Pipelines

PBT Group; Cape Town; On-site; ZAR 600,000 - 900,000; Full time

Job summary

PBT Group is seeking a strong Data Engineer with traditional data engineering experience and hands-on exposure to AI/LLMs/Agentic AI. The role focuses on data migration and modernization projects, with emphasis on building robust data pipelines and cloud-native solutions.

The ideal candidate has 3+ years of data engineering experience, is proficient in Python and SQL, and comfortable with REST APIs, Docker, and CI/CD within modern software practices.

Qualifications

• 3+ years Data Engineering experience.
• Strong Python and SQL.
• Experience with data pipelines, ETL/ELT and cloud data platforms.
• Exposure to AI / LLMs / Agentic AI or frameworks such as LangChain, LangGraph, LlamaIndex, AutoGen or CrewAI.
• Experience with REST APIs, Docker, CI/CD and modern software engineering practices.
• GCP preferred, but strong Azure experience will also be considered.

Responsibilities

• Develop and maintain data pipelines for migration and modernization projects.
• Collaborate with data teams to design scalable cloud data solutions.
• Implement ETL/ELT processes and ensure data quality and governance.

Skills

Data pipeline design

Python

SQL

ETL/ELT

CI/CD

REST APIs

Cloud data platforms

Tools

LangChain

LangGraph

LlamaIndex

AutoGen

CrewAI

Job description

PBT Group is seeking a strong Data Engineer with traditional data engineering experience and hands-on exposure to AI/LLMs/Agentic AI. The role focuses on data migration and modernization projects, with emphasis on building robust data pipelines and cloud-native solutions.

The ideal candidate has 3+ years of data engineering experience, is proficient in Python and SQL, and comfortable with REST APIs, Docker, and CI/CD within modern software practices.