Software & Data Engineer – Banking (CIB)

Blue Pearl PTY; Johannesburg; Hybrid; ZAR 900,000 - 1,450,000; Full time

Job summary

BluePearl Consulting is seeking an experienced Software & Data Engineer to join a software and data engineering team within a Corporate and Investment Banking environment. This role requires a combination of software engineering and data engineering expertise.

The successful candidate will develop and support reliable data pipelines, reusable software components, cloud-based processing solutions and integrations, applying sound software engineering principles throughout the development

Qualifications

• Relevant banking or financial services exposure is preferred.
• Software engineering experience with data engineering capabilities.
• Strong Python engineering skills, reusable modules and testing.
• Advanced SQL skills including CTEs and window functions.
• ETL/ELT, data ingestion and transformation experience.
• Hands-on AWS cloud engineering experience as core platform.

Responsibilities

• Design, develop and maintain software components and data engineering solutions.
• Build scalable data ingestion, transformation and integration pipelines.
• Develop reusable Python modules and services.
• Write, optimise and troubleshoot SQL queries.
• Apply engineering standards and CI/CD practices.
• Work with AWS to develop data-intensive applications.
• Maintain ETL/ELT workflows and data processing components.
• Develop APIs and integrations as needed.
• Implement automated testing and monitoring.
• Contribute to Git-based version control and release pipelines.
• Support deployment, quality gates and runbooks.

Skills

Python

AWS

Advanced SQL

ETL/ELT

Data integration

Git & CI/CD

Automated testing

Monitoring & production support

Data governance & quality

Spark/PySpark

Kafka

Airflow/MWAA

Step Functions

Terraform

APIs

Data warehouses / lakes

Cloud cost optimisation

Tools

Spark & PySpark

Kafka

Airflow/MWAA

Step Functions

Terraform

APIs

AWS S3/Glue/Lambda/Athena/Redshift/EMR

Job description

Johannesburg, South Africa | Posted on 10/28/2026

Department: Corporate and Investment Banking (CIB)

Contract Duration: 12 months, with potential extension up to 36 months

Expected Start Date: 1 January 2027

Location: Rosebank, Johannesburg, Gauteng

Work Arrangement: Hybrid - approximately 3 days onsite per week

Job Summary

BluePearl Consulting is seeking an experienced Software & Data Engineer to join a software and data engineering team within a Corporate and Investment Banking (CIB) environment.

This role requires a combination of software engineering and data engineering expertise. The successful candidate will develop and support reliable data pipelines, reusable software components, cloud-based processing solutions and integrations, applying sound software engineering principles throughout the development lifecycle.

The ideal candidate will have strong Python and SQL skills, hands-on AWS experience, knowledge of ETL/ELT processes and experience with automated testing, CI/CD, monitoring and production support.

The candidate must be a self-starter who can work independently, take ownership of technical deliverables and communicate effectively with technical and business stakeholders.

Key Responsibilities

Design, develop and maintain software components and data engineering solutions.

Build scalable data ingestion, transformation and integration pipelines.

Develop reusable, maintainable and testable Python modules and services.

Write, optimise and troubleshoot SQL queries.

Apply software engineering principles, coding standards and appropriate design practices.

Work with AWS cloud services to develop and support data-intensive applications.

Develop and maintain ETL/ELT workflows and data processing components.

Build and support APIs, integrations and event-driven components where required.

Implement automated unit, integration, regression and reconciliation testing.

Contribute to Git-based version control and CI/CD pipelines.

Support automated deployment, quality gates and release processes.

Work with distributed processing and event-streaming technologies where required.

Implement logging, monitoring, alerting and operational support mechanisms.

Troubleshoot application and data pipeline incidents and conduct root-cause analysis.

Apply security, access control, encryption and data privacy practices.

Maintain technical documentation, solution designs and operational runbooks.

Collaborate with Data Engineers, Software Engineers and business stakeholders.

Contribute to technical reviews, solution design and continuous improvement.

Non-Negotiable Requirements

Relevant banking or financial services experience.

Demonstrable software engineering experience combined with Data Engineering capability.

Strong Python engineering skills, including reusable modules, libraries and testing.

Advanced SQL skills, including CTEs, window functions, query plans and optimisation.

Practical ETL/ELT, data ingestion and transformation experience.

Hands-on cloud engineering experience, with AWS as the core platform requirement.

Experience with Git, CI/CD pipelines and automated deployments.

Knowledge of automated testing, production monitoring and incident troubleshooting.

Understanding of data quality, reconciliation, security and privacy controls.

Strong problem-solving and technical documentation skills.

Ability to work independently and take ownership of technical deliverables.

Excellent communication and stakeholder management skills.

Availability to work onsite in Rosebank approximately 3 days per week.

Availability to commence on 1 January 2027.

Core Technical Skills

AWS

Python and software development

Advanced SQL

ETL/ELT and data pipeline development

Data integration

Git and CI/CD

Automated testing

Cloud-based processing

Monitoring, logging and production support

Data quality and reconciliation

Role-Critical Technologies

AWS S3, Glue, Lambda, Athena, Redshift and EMR.

Serverless processing and cloud-native engineering.

Spark and PySpark.

Kafka and event-driven processing.

SQS, SNS and EventBridge.

Airflow/MWAA and Step Functions.

APIs and software-to-data integrations.

Data warehouses, data lakes and lakehouse architectures.

Terraform and Infrastructure as Code.

Automated deployment and operational resilience.

Performance tuning, monitoring and production readiness.

Experience with batch processing and workflow scheduling.

Data governance, ownership and classification.

Cloud cost optimisation and FinOps awareness.

Legacy system modernisation and cloud migration.

Data products, interfaces and service-level agreements/objectives.

Data mesh concepts and federated governance.

Core Attributes

Strong banking or financial services awareness.

Combines software engineering discipline with data engineering capability.

Self-starter who works effectively with minimal supervision.

Takes ownership of code, pipelines, deployments and deliverables.

Proactive problem-solver with strong analytical skills.

Strong attention to detail, reliability and quality.

Effective collaboration with technical and business stakeholders.

Smart and professional presentation appropriate to a banking environment.