Hybrid Software & Data Engineer - AWS, Python & SQL

Blue Pearl Pty Ltd; Johannesburg; Híbrido; ZAR 900.000 - 1.200.000; Jornada completa

Descripción de la vacante

BluePearl Consulting is seeking an experienced Software & Data Engineer to join a software and data engineering team within a Corporate and Investment Banking environment. The role combines software and data engineering to develop and support reliable data pipelines, reusable components, cloud-based processing solutions, and integrations.

The ideal candidate will have strong Python and SQL skills, hands-on AWS experience, ETL/ELT knowledge, and experience with automated testing, CI/CD,

Formación

• Banking/financial services experience is required.
• Software engineering experience combined with data engineering.
• Strong Python engineering skills with reusable modules and testing.
• Advanced SQL skills including CTEs, window functions and optimisation.
• Practical ETL/ELT, data ingestion and transformation experience.
• Hands-on AWS cloud experience as core platform.
• Experience with Git, CI/CD and automated deployments.
• Knowledge of automated testing, production monitoring and incident troubleshooting.
• Understanding of data quality, reconciliation, security and privacy controls.
• Independent worker with ownership of deliverables.
• Excellent communication with stakeholders.
• Availability to work onsite in Rosebank ~3 days per week.
• Availability to commence 1 January 2027.

Responsabilidades

• Design, develop and maintain software components and data engineering solutions.
• Build scalable data ingestion, transformation and integration pipelines.
• Develop reusable, maintainable Python modules and services.
• Write, optimise and troubleshoot SQL queries.
• Apply software engineering principles and coding standards.
• Work with AWS cloud services to develop data-intensive applications.
• Develop and maintain ETL/ELT workflows and data processing components.
• Build and support APIs, integrations and event-driven components.
• Implement automated unit, integration and regression tests.
• Contribute to Git-based version control and CI/CD pipelines.
• Support automated deployment, quality gates and release processes.
• Work with distributed processing and event-streaming technologies.
• Implement logging, monitoring and operational support mechanisms.
• Troubleshoot incidents and conduct root-cause analysis.
• Apply security, access control, encryption and data privacy practices.
• Maintain technical documentation and runbooks.
• Collaborate with Data Engineers, Software Engineers and stakeholders.
• Contribute to technical reviews and continuous improvement.

Conocimientos

Python engineering

SQL

AWS

Data engineering

CI/CD

Automated testing

Herramientas

Git

Airflow/MWAA

ETL/ELT

Spark/PySpark

Kubernetes

Descripción del empleo

BluePearl Consulting is seeking an experienced Software & Data Engineer to join a software and data engineering team within a Corporate and Investment Banking environment. The role combines software and data engineering to develop and support reliable data pipelines, reusable components, cloud-based processing solutions, and integrations.

The ideal candidate will have strong Python and SQL skills, hands-on AWS experience, ETL/ELT knowledge, and experience with automated testing, CI/CD,