AI Data Engineer – Migration

PBT Group; Cape Town; On-site; ZAR 700,000 - 900,000; Full time

Job summary

PBT Group in South Africa is seeking an AI Data Engineer – Migration to join a data modernisation initiative. You will blend traditional data engineering with AI-enabled, agentic technologies to support data migration, discovery, schema mapping and validation.

You will design pipelines, work with AI agents, integrate AI workflows with cloud platforms (AWS/Azure/GCP), ensure data quality, governance and security while collaborating with stakeholders.

Qualifications

• 3+ years' Data Engineering experience.
• Strong Python and SQL skills.
• Experience with ETL/ELT pipelines and data transformation.
• Cloud data environment exposure (AWS/Azure/GCP).
• Exposure to AI, LLMs or AI agents.
• APIs, microservices, Docker or CI/CD advantageous.
• Analytical and problem-solving ability.
• Comfort with complex/legacy data environments.

Responsibilities

• Design and develop data migration and modernisation pipelines.
• Work with AI agents to automate discovery, schema mapping, transformation and validation.
• Integrate AI/agentic workflows with traditional Data Engineering platforms and tools.
• Analyse legacy data structures and support migration to modern cloud environments.
• Build data-quality, validation and human-in-the-loop processes.
• Develop and integrate APIs and data services.
• Collaborate with technical teams to ensure scalable, reliable and secure solutions.
• Apply AI-assisted development tools while reviewing and validating outputs.
• Support data governance, security and privacy requirements.

Skills

Data Engineering

Python

SQL

ETL/ELT pipelines

Cloud (AWS/Azure/GCP)

AI/LLMs/Agents

APIs & microservices

Docker / CI/CD

Analytical thinking

Legacy data environments

Education

Bachelor's or Master's in CS/Data Eng/AI/IT or related field

Tools

LangChain

LangGraph

OpenAI API

Anthropic API

LlamaIndex

AutoGen

CrewAI

RAG / Vector DB

Job description

We are looking for an AI Data Engineer – Migration to join a specialist data modernisation initiative, combining traditional Data Engineering with emerging AI and agentic technologies.

The role will focus on using AI-assisted and agent-based solutions to support complex data migration and modernisation, including data discovery, schema mapping, transformation, validation and data-quality processes.

We are not looking for an exact technology match. Strong Data Engineering experience combined with practical exposure to AI, LLMs or agentic development will be considered.

What You'll Be Doing

• Design and develop data migration and modernisation pipelines.
• Work with AI agents to automate data discovery, schema mapping, transformation and validation.
• Integrate AI/agentic workflows with traditional Data Engineering platforms and tools.
• Analyse legacy data structures and support migration to modern cloud environments.
• Build data-quality, validation and human-in-the-loop processes.
• Develop and integrate APIs and data services.
• Work with technical teams to ensure solutions are scalable, reliable and secure.
• Apply AI-assisted development tools while reviewing and validating generated outputs.
• Support data governance, security and privacy requirements.

What We're Looking For

Essential / Relevant Experience

• 3+ years' experience in Data Engineering.
• Strong Python and SQL skills.
• Experience with ETL/ELT pipelines and data transformation.
• Experience with a cloud data environment such as AWS, Azure or GCP.
• Exposure to AI, LLMs, Generative AI or AI agents.
• Experience with APIs, microservices, Docker or CI/CD would be advantageous.
• Strong analytical and problem-solving ability.
• Comfortable working with complex or legacy data environments.
• Ability to work independently and collaborate with technical and business stakeholders.

AI / Agentic Experience

Exposure to technologies such as the following would be advantageous:

• LangChain / LangGraph
• AutoGen / CrewAI / LlamaIndex
• OpenAI / Anthropic / other LLM APIs
• Prompt engineering and structured outputs
• RAG / Vector Databases
• AI-assisted coding and development tools

You do not need experience across all of the above. We are particularly interested in candidates who understand the concepts and have hands‑on exposure to applying AI within Data Engineering or software development.

Advantageous Experience

• Legacy-to-modern data migration or application modernisation.
• AWS, Azure or GCP data platforms.
• Spark / PySpark, dbt, Airflow, Snowflake, BigQuery or Databricks.
• Experience working with legacy relational, mainframe or NoSQL data.
• Data quality, testing and validation frameworks.
• Experience implementing AI solutions within regulated or enterprise environments.

Qualifications

A Bachelor's or Master's degree in Computer Science, Data Engineering, Artificial Intelligence, Information Technology or a related field would be advantageous.

Why Join?

This is an opportunity to work at the intersection of Data Engineering, AI and modernisation, contributing to practical solutions that use emerging agentic technologies to solve complex data migration challenges.