AI Data Engineer

PBT Group; Cape Town; On-site; ZAR 600,000 - 900,000; Full time

Job summary

PBT Group in Cape Town is seeking an AI Data Engineer – Migration to blend traditional Data Engineering with AI and agentic technologies for data modernisation. You will design and build migration pipelines, enable AI-assisted discovery and transformation, and ensure compliant, scalable data solutions.

The role emphasizes data discovery, schema mapping, transformation and validation, with cloud migration and strong collaboration with technical teams.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, AI or IT.
• 3+ years’ experience in Data Engineering.
• Strong Python and SQL skills.
• Experience with ETL/ELT pipelines and data transformation.
• Experience with a cloud data environment such as AWS, Azure or GCP.
• Exposure to AI, LLMs, Generative AI or AI agents.
• Experience with APIs, microservices, Docker or CI/CD would be advantageous.
• Strong analytical and problem-solving ability.
• Comfortable working with complex or legacy data environments.
• Ability to work independently and collaborate with technical and business stakeholders.
• AI / Agentic Experience
• Exposure to technologies such as LangChain / LangGraph, AutoGen / CrewAI / LlamaIndex, OpenAI / Anthropic / other LLM APIs, Prompt engineering and structured outputs, RAG / Vector Databases, AI-assisted coding and development tools

Responsibilities

• Design and develop data migration and modernisation pipelines.
• Work with AI agents to automate data discovery, schema mapping, transformation and validation.
• Integrate AI/agentic workflows with traditional Data Engineering platforms and tools.
• Analyse legacy data structures and support migration to modern cloud environments.
• Build data-quality, validation and human-in-the-loop processes.
• Develop and integrate APIs and data services.
• Work with technical teams to ensure solutions are scalable, reliable and secure.
• Apply AI-assisted development tools while reviewing and validating generated outputs.
• Support data governance, security and privacy requirements.

Skills

Python

SQL

Data Engineering

ETL/ELT pipelines

AWS

Azure

GCP

AI / LLMs exposure

APIs

Docker

CI/CD

Education

Bachelor's or Master's degree in Computer Science/Data Engineering/AI/IT

Tools

LangChain

LlamaIndex

OpenAI APIs

Job description

AI Data Engineer (Migration) job vacancy in Cape Town.

We are looking for an AI Data Engineer – Migration to join a specialist data modernisation initiative, combining traditional Data Engineering with emerging AI and agentic technologies.

The role will focus on using AI-assisted and agent-based solutions to support complex data migration and modernisation, including data discovery, schema mapping, transformation, validation and data-quality processes.

We are not looking for an exact technology match. Strong Data Engineering experience combined with practical exposure to AI, LLMs or agentic development will be considered.

What You’ll Be Doing:

• Design and develop data migration and modernisation pipelines.
• Work with AI agents to automate data discovery, schema mapping, transformation and validation.
• Integrate AI/agentic workflows with traditional Data Engineering platforms and tools.
• Analyse legacy data structures and support migration to modern cloud environments.
• Build data-quality, validation and human-in-the-loop processes.
• Develop and integrate APIs and data services.
• Work with technical teams to ensure solutions are scalable, reliable and secure.
• Apply AI-assisted development tools while reviewing and validating generated outputs.
• Support data governance, security and privacy requirements.

What We’re Looking For:

• A Bachelor’s or Master’s degree in Computer Science, Data Engineering, Artificial Intelligence, Information Technology or a related field would be advantageous.
• 3+ years’ experience in Data Engineering.
• Strong Python and SQL skills.
• Experience with ETL/ELT pipelines and data transformation.
• Experience with a cloud data environment such as AWS, Azure or GCP.
• Exposure to AI, LLMs, Generative AI or AI agents.
• Experience with APIs, microservices, Docker or CI/CD would be advantageous.
• Strong analytical and problem-solving ability.
• Comfortable working with complex or legacy data environments.
• Ability to work independently and collaborate with technical and business stakeholders.
• AI / Agentic Experience
• Exposure to technologies such as the following would be advantageous:
• LangChain / LangGraph
• AutoGen / CrewAI / LlamaIndex
• OpenAI / Anthropic / other LLM APIs
• Prompt engineering and structured outputs
• RAG / Vector Databases
• AI-assisted coding and development tools

You do not need experience across all of the above. We are particularly interested in candidates who understand the concepts and have hands‑on exposure to applying AI within Data Engineering or software development.

Advantageous Experience:

• Legacy‑to‑modern data migration or application modernisation.
• AWS, Azure or GCP data platforms.
• Spark / PySpark, dbt, Airflow, Snowflake, BigQuery or Databricks.
• Experience working with legacy relational, mainframe or NoSQL data.
• Data quality, testing and validation frameworks.
• Experience implementing AI solutions within regulated or enterprise environments.

Why Join?

This is an opportunity to work at the intersection of Data Engineering, AI and modernisation, contributing to practical solutions that use emerging agentic technologies to solve complex data migration challenges.