Senior Data Engineer

Blue Pearl PTY LTD; Johannesburg; On-site; ZAR 900,000 - 1,300,000; Full time

Job summary

Blue Pearl PTY LTD in Johannesburg seeks an experienced Senior Data Engineer to join a greenfield data platform initiative in the healthcare and medical scheme space. The role is highly technical and delivery-focused, building the MVP and establishing architecture, standards, and reusable patterns for long-term scalability and automation.

The successful candidate will translate business requirements into robust technical solutions while operating in a POPIA-sensitive health-data environment and

Qualifications

• Extensive hands-on experience in data platform engineering.
• Strong knowledge of Snowflake, dbt, AWS, Fivetran and Power BI.
• Ability to translate business requirements into scalable technical solutions.
• Experience implementing DataOps, CI/CD and data quality frameworks.
• Ability to operate in a POPIA-sensitive health-data environment.

Responsibilities

• Design and build the future-state data platform MVP, including scalable data pipelines and transformation processes.
• Develop and implement automated data ingestion and integration patterns.
• Build robust and reusable Snowflake data models aligned to business needs.
• Develop transformation workflows using dbt and analytics engineering practices.
• Implement data ingestion using Fivetran and establish reliable integration patterns.
• Design and implement automated data quality checks, testing and validation frameworks.
• Establish monitoring and controls to ensure data accuracy, reliability, availability and performance.
• Apply CI/CD practices across data and analytics engineering workflows.
• Promote DataOps to improve automation, deployment, monitoring and reliability.
• Support migration from legacy reporting to the target-state architecture.
• Establish reusable engineering standards, frameworks, patterns and documentation.
• Develop and support the Power BI reporting layer for the MVP.
• Collaborate with stakeholders to translate requirements into scalable solutions.
• Ensure security, governance, metadata management and POPIA considerations.
• Provide technical guidance and knowledge transfer to Medscheme staff.
• Troubleshoot issues and improve performance, scalability and reliability.

Skills

Data platform engineering

Data pipelines

Analytics requirements translation

Tools

Snowflake

dbt

AWS

Fivetran

Power BI

Job description

We are seeking an experienced Senior Data Engineer to join a high-impact greenfield data platform initiative within the healthcare and medical scheme administration environment.

This is a highly technical, delivery-focused role responsible for building the future-state MVP and establishing the foundational architecture, engineering standards and reusable patterns required to support the long-term scalability and automation of the data platform.

The successful candidate will be comfortable working independently, translating business and analytics requirements into robust technical solutions, and operating within a POPIA-sensitive health-data environment.

Key Responsibilities

• Design and build the future-state data platform MVP, including scalable data pipelines and transformation processes.
  
• Develop and implement automated data ingestion and integration patterns.
  
• Build robust and reusable Snowflake data models aligned to business and analytics requirements.
  
• Develop transformation workflows using dbt, applying modern analytics engineering practices.
  
• Implement data ingestion using Fivetran and establish reliable integration patterns.
  
• Design and implement automated data quality checks, testing and validation frameworks.
  
• Establish monitoring and controls to ensure data accuracy, reliability, availability and performance.
  
• Apply CI/CD practices across data and analytics engineering workflows.
  
• Implement and promote DataOps practices to improve automation, deployment, monitoring and operational reliability.
  
• Support migration from legacy reporting processes to the target-state data architecture.
  
• Establish reusable engineering standards, frameworks, patterns and documentation for future phases of the platform.
  
• Develop and support the Power BI reporting layer required for the MVP.
  
• Collaborate with business, analytics and technical stakeholders to translate requirements into scalable technical solutions.
  
• Ensure solutions are designed with appropriate security, governance, metadata management and POPIA considerations.
  
• Provide technical guidance and knowledge transfer to Medscheme staff, supporting the sustainable adoption of the new platform.
  
• Troubleshoot technical issues and continuously improve the performance, scalability and reliability of the data platform.
  

Requirements

Required Technical Skills

The successful candidate must have strong, hands-on experience with the following technologies and disciplines:

• Snowflake
  
• dbt
  
• AWS
  
• Fivetran
  
• Power BI