Banking Data Engineer - AWS, ETL & PySpark (Hybrid)

Blue Pearl PTY; Johannesburg; Hybrid; ZAR 900,000 - 1,300,000; Full time

Job summary

BluePearl Consulting is seeking an experienced Data Engineer to join a CIB data engineering team in Rosebank, Johannesburg. The role focuses on designing and maintaining scalable data pipelines, data integration, and cloud-based platforms with AWS as the core platform.

The candidate should excel in SQL and Python, ETL/ELT, data modelling, and data quality. Hybrid work arrangement is expected, with onsite presence ~3 days per week and an anticipated start on 1 January 2027.

Qualifications

• Strong hands-on Data Engineering experience in a banking/financial services environment.
• Advanced SQL engineering including CTEs and window functions.
• Proficient Python development with reusable modules and tests.
• ETL/ELT, data ingestion and transformation experience.
• Cloud data engineering with AWS as core platform.

Responsibilities

• Design, develop and maintain scalable ETL/ELT pipelines and ingestion processes.
• Write, optimise and troubleshoot advanced SQL queries (CTEs, window functions).
• Develop reusable Python modules and automated tests.
• Build and maintain relational, dimensional and analytical data models.
• Implement data transformations, mappings, validation and reconciliation.
• Develop data pipelines using AWS data services and orchestration tools.
• Work with Spark/PySpark and distributed processing when required.
• Support data warehousing, data lakes, and lakehouse architectures.
• Implement data quality rules, logging and observability.
• Maintain documentation, runbooks and data mappings.

Skills

Advanced SQL

Python engineering

ETL/ELT

Data modelling

AWS cloud

Data quality

Data governance

CI/CD

Tools

Airflow

Terraform

Delta Lake

Spark/PySpark

Kafka

Job description

BluePearl Consulting is seeking an experienced Data Engineer to join a CIB data engineering team in Rosebank, Johannesburg. The role focuses on designing and maintaining scalable data pipelines, data integration, and cloud-based platforms with AWS as the core platform.

The candidate should excel in SQL and Python, ETL/ELT, data modelling, and data quality. Hybrid work arrangement is expected, with onsite presence ~3 days per week and an anticipated start on 1 January 2027.