AI-Driven Data Migration Engineer

PBT Group; Cape Town; On-site; ZAR 700,000 - 900,000; Full time

Job summary

PBT Group in South Africa is seeking an AI Data Engineer – Migration to join a data modernisation initiative. You will blend traditional data engineering with AI-enabled, agentic technologies to support data migration, discovery, schema mapping and validation.

You will design pipelines, work with AI agents, integrate AI workflows with cloud platforms (AWS/Azure/GCP), ensure data quality, governance and security while collaborating with stakeholders.

Qualifications

• 3+ years' Data Engineering experience.
• Strong Python and SQL skills.
• Experience with ETL/ELT pipelines and data transformation.
• Cloud data environment exposure (AWS/Azure/GCP).
• Exposure to AI, LLMs or AI agents.
• APIs, microservices, Docker or CI/CD advantageous.
• Analytical and problem-solving ability.
• Comfort with complex/legacy data environments.

Responsibilities

• Design and develop data migration and modernisation pipelines.
• Work with AI agents to automate discovery, schema mapping, transformation and validation.
• Integrate AI/agentic workflows with traditional Data Engineering platforms and tools.
• Analyse legacy data structures and support migration to modern cloud environments.
• Build data-quality, validation and human-in-the-loop processes.
• Develop and integrate APIs and data services.
• Collaborate with technical teams to ensure scalable, reliable and secure solutions.
• Apply AI-assisted development tools while reviewing and validating outputs.
• Support data governance, security and privacy requirements.

Skills

Data Engineering

Python

SQL

ETL/ELT pipelines

Cloud (AWS/Azure/GCP)

AI/LLMs/Agents

APIs & microservices

Docker / CI/CD

Analytical thinking

Legacy data environments

Education

Bachelor's or Master's in CS/Data Eng/AI/IT or related field

Tools

LangChain

LangGraph

OpenAI API

Anthropic API

LlamaIndex

AutoGen

CrewAI

RAG / Vector DB

Job description

PBT Group in South Africa is seeking an AI Data Engineer – Migration to join a data modernisation initiative. You will blend traditional data engineering with AI-enabled, agentic technologies to support data migration, discovery, schema mapping and validation.

You will design pipelines, work with AI agents, integrate AI workflows with cloud platforms (AWS/Azure/GCP), ensure data quality, governance and security while collaborating with stakeholders.