Banking Data Engineer – AWS, SQL & Python Expert

Blue Pearl Pty Ltd; Johannesburg; Hybrid; ZAR 950,000 - 1,350,000; Full time

Benefits offered by this job

Hybrid work arrangement

Job summary

BluePearl Consulting is seeking a Data Engineer to join a corporate and investment banking data team in Rosebank. The role focuses on scalable data pipelines, cloud-based platforms on AWS and strong SQL/Python engineering, with hybrid onsite work and a Jan 1 2027 start.

You will design ETL/ELT processes, model data, and implement data quality, security and observability across data lakes, warehouses and lakehouse architectures.

Qualifications

• Relevant banking or financial services experience.
• Hands-on Data Engineering experience.
• Advanced SQL engineering including CTEs and window functions.
• Strong Python engineering with testing.
• ETL/ELT, data ingestion and transformation experience.
• Data modelling across relational, dimensional or analytical models.
• Cloud data engineering with AWS as core platform.
• Data quality, validation and reconciliation knowledge.
• Data security and privacy awareness.
• Familiarity with Git, CI/CD and production support.
• Ability to work independently and communicate clearly.
• Availability to work onsite in Rosebank ~3 days per week.
• Availability to commence on 1 January 2027.

Responsibilities

• Design, develop and maintain scalable ETL/ELT pipelines and ingestion.
• Write and optimise advanced SQL queries with CTEs and window functions.
• Develop reusable Python modules and automated tests.
• Build and maintain relational, dimensional and analytical models.
• Implement data transformations, mappings and validation processes.
• Develop data pipelines using AWS data services.
• Orchestrate data workflows with appropriate tools.
• Work with Spark/PySpark where required.
• Support data warehouses, data lakes and lakehouses.
• Implement data quality rules, reconciliation and observability.
• Ensure data security, access controls and privacy practices.
• Contribute to CI/CD, version control and deployment pipelines.
• Develop unit/integration/regression tests; troubleshoot incidents.
• Document data mappings, designs and runbooks; collaborate with teams.

Skills

Advanced SQL

Python

ETL/ELT

Data ingestion

Data modelling

AWS

Spark

Git/CI/CD

Data quality

Data governance

Airflow

Delta Lake

Kafka

Tools

Kafka

Airflow

Terraform

MWAA

Delta Lake

Job description

BluePearl Consulting is seeking a Data Engineer to join a corporate and investment banking data team in Rosebank. The role focuses on scalable data pipelines, cloud-based platforms on AWS and strong SQL/Python engineering, with hybrid onsite work and a Jan 1 2027 start.

You will design ETL/ELT processes, model data, and implement data quality, security and observability across data lakes, warehouses and lakehouse architectures.