Software & Data Engineer – Banking (Cib)

Blue Pearl Pty Ltd; Johannesburg; Hybrid; ZAR 900,000 - 1,200,000; Full time

Job summary

BluePearl Consulting is seeking an experienced Software & Data Engineer to join a software and data engineering team within a Corporate and Investment Banking environment. The role combines software and data engineering to develop and support reliable data pipelines, reusable components, cloud-based processing solutions, and integrations.

The ideal candidate will have strong Python and SQL skills, hands-on AWS experience, ETL/ELT knowledge, and experience with automated testing, CI/CD,

Qualifications

• Banking/financial services experience is required.
• Software engineering experience combined with data engineering.
• Strong Python engineering skills with reusable modules and testing.
• Advanced SQL skills including CTEs, window functions and optimisation.
• Practical ETL/ELT, data ingestion and transformation experience.
• Hands-on AWS cloud experience as core platform.
• Experience with Git, CI/CD and automated deployments.
• Knowledge of automated testing, production monitoring and incident troubleshooting.
• Understanding of data quality, reconciliation, security and privacy controls.
• Independent worker with ownership of deliverables.
• Excellent communication with stakeholders.
• Availability to work onsite in Rosebank ~3 days per week.
• Availability to commence 1 January 2027.

Responsibilities

• Design, develop and maintain software components and data engineering solutions.
• Build scalable data ingestion, transformation and integration pipelines.
• Develop reusable, maintainable Python modules and services.
• Write, optimise and troubleshoot SQL queries.
• Apply software engineering principles and coding standards.
• Work with AWS cloud services to develop data-intensive applications.
• Develop and maintain ETL/ELT workflows and data processing components.
• Build and support APIs, integrations and event-driven components.
• Implement automated unit, integration and regression tests.
• Contribute to Git-based version control and CI/CD pipelines.
• Support automated deployment, quality gates and release processes.
• Work with distributed processing and event-streaming technologies.
• Implement logging, monitoring and operational support mechanisms.
• Troubleshoot incidents and conduct root-cause analysis.
• Apply security, access control, encryption and data privacy practices.
• Maintain technical documentation and runbooks.
• Collaborate with Data Engineers, Software Engineers and stakeholders.
• Contribute to technical reviews and continuous improvement.

Skills

Python engineering

SQL

AWS

Data engineering

CI/CD

Automated testing

Tools

Git

Airflow/MWAA

ETL/ELT

Spark/PySpark

Kubernetes

Job description

Job Description

Resource Requirements

Company: BluePearl Consulting

Number of Vacancies: 1

Industry: Banking / Financial Services

Department: Corporate and Investment Banking (CIB)

Contract Duration: 12 months, with potential extension up to 36 months

Expected Start Date: 1 January 2027

Location: Rosebank, Johannesburg, Gauteng

Work Arrangement: Hybrid - approximately 3 days onsite per week

Job Summary

BluePearl Consulting is seeking an experienced Software & Data Engineer to join a software and data engineering team within a Corporate and Investment Banking (CIB) environment.

This role requires a combination of software engineering and data engineering expertise. The successful candidate will develop and support reliable data pipelines, reusable software components, cloud-based processing solutions and integrations, applying sound software engineering principles throughout the development lifecycle.

The ideal candidate will have strong Python and SQL skills, hands-on AWS experience, knowledge of ETL/ELT processes and experience with automated testing, CI/CD, monitoring and production support.

The candidate must be a self-starter who can work independently, take ownership of technical deliverables and communicate effectively with technical and business stakeholders.

Key Responsibilities

• Design, develop and maintain software components and data engineering solutions.
  

• Build scalable data ingestion, transformation and integration pipelines.
  

• Develop reusable, maintainable and testable Python modules and services.
  

• Write, optimise and troubleshoot SQL queries.
  

• Apply software engineering principles, coding standards and appropriate design practices.
  

• Work with AWS cloud services to develop and support data-intensive applications.
  

• Develop and maintain ETL/ELT workflows and data processing components.
  

• Build and support APIs, integrations and event-driven components where required.
  

• Implement automated unit, integration, regression and reconciliation testing.
  

• Contribute to Git-based version control and CI/CD pipelines.
  

• Support automated deployment, quality gates and release processes.
  

• Work with distributed processing and event-streaming technologies where required.
  

• Implement logging, monitoring, alerting and operational support mechanisms.
  

• Troubleshoot application and data pipeline incidents and conduct root-cause analysis.
  

• Apply security, access control, encryption and data privacy practices.
  

• Maintain technical documentation, solution designs and operational runbooks.
  

• Collaborate with Data Engineers, Software Engineers and business stakeholders.
  

• Contribute to technical reviews, solution design and continuous improvement.
  

Requirements

Non-Negotiable Requirements

• Relevant banking or financial services experience.
  

• Demonstrable software engineering experience combined with Data Engineering capability.
  

• Strong Python engineering skills, including reusable modules, libraries and testing.
  

• Advanced SQL skills, including CTEs, window functions, query plans and optimisation.
  

• Practical ETL/ELT, data ingestion and transformation experience.
  

• Hands-on cloud engineering experience, with AWS as the core platform requirement.
  

• Experience with Git, CI/CD pipelines and automated deployments.
  

• Knowledge of automated testing, production monitoring and incident troubleshooting.
  

• Understanding of data quality, reconciliation, security and privacy controls.
  

• Strong problem-solving and technical documentation skills.
  

• Ability to work independently and take ownership of technical deliverables.
  

• Excellent communication and stakeholder management skills.
  

• Availability to work onsite in Rosebank approximately 3 days per week.
  

• Availability to commence on 1 January 2027.
  

Core Technical Skills

• AWS
  

• Python and software development
  

• Advanced SQL
  

• ETL/ELT and data pipeline development
  

• Data integration
  

• Git and CI/CD
  

• Automated testing
  

• Cloud-based processing
  

• Monitoring, logging and production support
  

• Data quality and reconciliation
  

Role-Critical Technologies

• AWS S3, Glue, Lambda, Athena, Redshift and EMR.
  

• Serverless processing and cloud-native engineering.
  

• Spark and PySpark.
  

• Kafka and event-driven processing.
  

• SQS, SNS and EventBridge.
  

• Airflow/MWAA and Step Functions.
  

• APIs and software-to-data integrations.
  

• Data warehouses, data lakes and lakehouse architectures.
  

• Terraform and Infrastructure as Code.
  

• Automated deployment and operational resilience.
  

• Performance tuning, monitoring and production readiness.
  

Desirable Capabilities

• Experience with batch processing and workflow scheduling.
  

• Data governance, ownership and classification.
  

• Cloud cost optimisation and FinOps awareness.
  

• Legacy system modernisation and cloud migration.
  

• Data products, interfaces and service-level agreements/objectives.
  

• Data mesh concepts and federated governance.
  

Core Attributes

• Strong banking or financial services awareness.
  

• Combines software engineering discipline with data engineering capability.
  

• Self-starter who works effectively with minimal supervision.
  

• Takes ownership of code, pipelines, deployments and deliverables.
  

• Proactive problem-solver with strong analytical skills.
  

• Excellent written and verbal communication.
  

• Strong attention to detail, reliability and quality.
  

• Effective collaboration with technical and business stakeholders.
  

• Professional stakeholder engagement.
  

• Smart and professional presentation appropriate to a banking environment.
  

Recruitment priority: A strong hybrid Software & Data Engineer who combines practical software development skills with data pipeline engineering, AWS expertise, sound testing and deployment practices, and relevant banking experience.