AWS Data & Software Engineer – Hybrid

Blue Pearl PTY; Johannesburg; Hybrid; ZAR 900,000 - 1,450,000; Full time

Job summary

BluePearl Consulting is seeking an experienced Software & Data Engineer to join a software and data engineering team within a Corporate and Investment Banking environment. This role requires a combination of software engineering and data engineering expertise.

The successful candidate will develop and support reliable data pipelines, reusable software components, cloud-based processing solutions and integrations, applying sound software engineering principles throughout the development

Qualifications

• Relevant banking or financial services exposure is preferred.
• Software engineering experience with data engineering capabilities.
• Strong Python engineering skills, reusable modules and testing.
• Advanced SQL skills including CTEs and window functions.
• ETL/ELT, data ingestion and transformation experience.
• Hands-on AWS cloud engineering experience as core platform.

Responsibilities

• Design, develop and maintain software components and data engineering solutions.
• Build scalable data ingestion, transformation and integration pipelines.
• Develop reusable Python modules and services.
• Write, optimise and troubleshoot SQL queries.
• Apply engineering standards and CI/CD practices.
• Work with AWS to develop data-intensive applications.
• Maintain ETL/ELT workflows and data processing components.
• Develop APIs and integrations as needed.
• Implement automated testing and monitoring.
• Contribute to Git-based version control and release pipelines.
• Support deployment, quality gates and runbooks.

Skills

Python

AWS

Advanced SQL

ETL/ELT

Data integration

Git & CI/CD

Automated testing

Monitoring & production support

Data governance & quality

Spark/PySpark

Kafka

Airflow/MWAA

Step Functions

Terraform

APIs

Data warehouses / lakes

Cloud cost optimisation

Tools

Spark & PySpark

Kafka

Airflow/MWAA

Step Functions

Terraform

APIs

AWS S3/Glue/Lambda/Athena/Redshift/EMR

Job description

BluePearl Consulting is seeking an experienced Software & Data Engineer to join a software and data engineering team within a Corporate and Investment Banking environment. This role requires a combination of software engineering and data engineering expertise.

The successful candidate will develop and support reliable data pipelines, reusable software components, cloud-based processing solutions and integrations, applying sound software engineering principles throughout the development