Senior Data Architect & Engineer - Real-Time Analytics

AES Global; Johannesburg; Hybrid; ZAR 900,000 - 1,500,000; Full time

Job summary

AES Global is seeking a Senior Data Engineer to architect, build and lead scalable data solutions as part of an agile team. You’ll turn complex requirements into high-performing data architecture and build the infrastructure that turns raw data into insight at scale, in batch and real time.

You’ll act as a technical lead—translating requirements into architecture, leading analytics across projects, and creating data marts with ETL tools using Python, Hadoop (EMR), and AWS cloud feeds.

Qualifications

• Bachelor's degree in CS/CE or equivalent required.
• AWS certification or equivalent cloud-certification desirable.
• 6+ years of data-engineering or software-engineering experience, with 2+ years in big data.

Responsibilities

• Architect the data-analytics framework and lead batch and real-time analytical solutions.
• Translate complex functional and technical requirements into detailed architecture, design and high-performing software.
• Lead user-story analysis, design, development, testing and build-automation across multiple projects.
• Create data marts using Talend or a similar ETL tool, and manipulate data using Python.
• Process data using the Hadoop paradigm (e.g. EMR), and create and support data feeds into AWS Cloud.
• Develop for big data and business intelligence, including automated testing and deployment.

Skills

Data engineering

Python

PySpark

Spark

AWS

ETL

Hadoop

Big data

Data modeling

OO design

Education

Bachelor's degree in CS/CE or equivalent

AWS certification

Tools

Talend

Hadoop

EMR

BigQuery

DBT

AWS

GCP/Azure

Job description

AES Global is seeking a Senior Data Engineer to architect, build and lead scalable data solutions as part of an agile team. You’ll turn complex requirements into high-performing data architecture and build the infrastructure that turns raw data into insight at scale, in batch and real time.

You’ll act as a technical lead—translating requirements into architecture, leading analytics across projects, and creating data marts with ETL tools using Python, Hadoop (EMR), and AWS cloud feeds.