Data Engineer

Hire Resolve; Sandton; On-site; ZAR 700,000 - 1,000,000; Full time

Job summary

Hire Resolve seeks a Data Engineer to join a Bryanston-based technology team supporting a multi-tenant financial services data platform. You will build and optimize ETL pipelines, data models, and APIs while ensuring data quality and security in a cloud-based environment.

Requirements include a relevant Bachelor's degree and 2+ years in data engineering, with strong Python/SQL, Azure Data Factory, Synapse, and Data Lake skills.

Qualifications

• Bachelor's Degree in Data Science, Computer Science, Information Technology, or related field.
• Minimum 2 years' experience as a Data Engineer or similar role.
• Experience building and maintaining ETL pipelines.
• Working knowledge of cloud-based data platforms.
• Experience with relational and non-relational databases.
• Exposure to data warehousing concepts and best practices.
• Programming & Databases: Python, SQL, C#, PostgreSQL, Azure SQL and Relational & NoSQL databases
• Data Engineering: ETL Development, Data Pipeline Development, Data Modelling, Data Warehousing, Data Integration and Data Quality & Validation.
• Cloud Tech: Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Gen2, Azure Blob Storage, Azure Web Apps, Azure Entra ID, Azure Key Vault and RBAC
• DevOps and Tools: Azure DevOps, Git, Visual Studio, Visual Studio Code and Excel

Responsibilities

• Build, maintain, and optimize ETL pipelines from APIs, databases, and event-driven sources.
• Develop and maintain Data Platform APIs for reliable ingestion and access.
• Implement tenant-specific configurations with naming conventions.
• Apply tenant-level data isolation using schemas, partitions, and access controls.
• Build and maintain reporting and analytics data models.
• Monitor pipelines, troubleshoot failures, and resolve data quality issues.
• Maintain daily and incremental data warehouse loads.
• Assist onboarding new clients by validating source data and testing outputs.
• Collaborate with senior data engineers on multi-tenant architecture best practices.
• Collaborate with analytics, product, and customer teams to understand reporting requirements.
• Support regulatory and audit requirements per POPIA and company policies.
• Handle sensitive financial and personal data with encryption, masking, and least-privilege access.

Skills

Python

SQL

NoSQL databases

Azure Data Factory

Azure Synapse Analytics

ETL Development

Data Modelling

RBAC

Data Warehousing

Data Quality & Validation

Azure Data Lake Gen2

C#

Education

Bachelor's degree in Data Science

Bachelor's degree in Computer Science

Bachelor's degree in Information Technology

Related field

Tools

Azure DevOps

Git

Visual Studio

Visual Studio Code

Excel

Job description

Our client is looking for a Data Engineer to join their growing technology team supporting a multi-tenant financial services data platform in Bryanston, GP. This role is ideal for someone with a passion for building reliable, secure, and scalable data solutions while working alongside analytics, product, risk, and compliance teams.

You will play a key role in developing and maintaining data pipelines, ensuring high-quality data delivery, and supporting the ongoing enhancement of the company's cloud-based data platform.

Responsibilities:

• Build, maintain, and optimize ETL pipelines that ingest data from APIs, databases, and event-driven sources.
• Develop and maintain Data Platform APIs to enable reliable data ingestion and access.
• Implement tenant-specific configurations while adhering to established naming conventions.
• Apply tenant-level data isolation using schemas, partitions, and access controls.
• Build and maintain reporting and analytics data models using existing templates and shared standards.
• Monitor scheduled pipelines, troubleshoot failures, and resolve data quality issues.
• Maintain daily and incremental data warehouse loads.
• Assist with onboarding new clients by validating source data and testing pipeline outputs.
• Work closely with senior data engineers to implement best practices for multi-tenant architecture.
• Collaborate with analytics, product, and customer-facing teams to understand reporting requirements.
• Support regulatory and audit requirements by following data governance, retention, and audit standards.
• Handle sensitive financial and personal information (PII) in accordance with POPIA and company policies.
• Implement security best practices, including role-based access control, encryption, masking, and least-privilege access.

Requirements:

• Bachelor's Degree in:
  • Data Science
  • Computer Science
  • Information Technology
  • Or a related field
• Minimum 2 years' experience as a Data Engineer or in a similar technical role.
• Experience building and maintaining ETL pipelines.
• Working knowledge of cloud-based data platforms.
• Experience with relational and non-relational databases.
• Exposure to data warehousing concepts and best practices.
• Programming & Databases: Python, SQL, C#, PostgreSQL, Azure SQL and Relational & NoSQL databases
• Data Engineering: ETL Development, Data Pipeline Development, Data Modelling, Data Warehousing, Data Integration and Data Quality & Validation.
• Cloud Tech: Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Gen2, Azure Blob Storage, Azure Web Apps, Azure Entra ID, Azure Key Vault and RBAC (Role-Based Access Control)
• DevOps and Tools: Azure DevOps, Git, Visual Studio, Visual Studio Code and Excel

Advantageous:

• Cloud Data Certifications
• Experience within Financial Services or FinTech
• Exposure to regulated environments