Data Engineer: Hybrid Role for Scalable Analytics Pipelines

Vitality; Johannesburg; Hybrid; ZAR 700,000 - 1,000,000; Full time

Benefits offered by this job

Bonus schemes

Retirement support

Health & wellbeing

Financial protection

Job summary

Vitality is seeking a Data Engineer to design, build and maintain robust data pipelines that support analytics, ML and BI initiatives. You will collaborate with Data Science, Data Architecture and technology teams while evolving cloud and big data environments.

The role focuses on scalable data platforms, trusted datasets and production-grade data solutions, with hybrid work in the Sandton office and flexible arrangements. A strong SQL/Python skill set is essential.

Qualifications

• Bachelor’s degree in Information Technology, Systems, Science, Mathematics or Engineering.
• Experience in business intelligence, data warehousing, data management and data delivery environments.
• Strong SQL development skills.
• Commercial experience with Python and/or Apache Spark.
• Experience designing and delivering data solutions across data warehouses and big data platforms.
• Hands-on experience with large-scale data technologies and toolsets.
• Ability to work independently while collaborating across multiple technical teams.
• Strong analytical and problem-solving skills with root cause analysis.
• Experience using GitHub, GitLab or similar repositories.
• Knowledge of cloud-based data engineering technologies and modern data architectures.
• Desirable: SSIS, Data Factory, AWS Glue, Dataflow or Dataproc.
• DBT knowledge and Agile delivery experience are advantageous.

Responsibilities

• Design, develop and maintain robust data pipelines across source systems.
• Support Kafka streaming solutions and data products for analytics and ML.
• Deploy and maintain ML models via API-based production deployments.
• Develop datasets, processes and data structures to support modelling and analytics.
• Collaborate with Data Science and Architecture teams to implement scalable data solutions.
• Ensure data quality, integrity and reliability; identify and improve processes.
• Perform root cause analysis on data issues and implement durable fixes.
• Contribute to data engineering design principles and forums within the team.
• Use source control and modern deployment practices for controlled software delivery.
• Support both cloud and on-prem environments delivering data engineering at scale.

Skills

Data engineering

SQL

Python

Data warehousing

Education

Bachelor's degree in IT/CS/Math/Engineering

Tools

Kafka

Apache Spark

GitHub

GitLab

SSIS

Data Factory

AWS Glue

Dataflow

Dataproc

DBT

Job description

Vitality is seeking a Data Engineer to design, build and maintain robust data pipelines that support analytics, ML and BI initiatives. You will collaborate with Data Science, Data Architecture and technology teams while evolving cloud and big data environments.

The role focuses on scalable data platforms, trusted datasets and production-grade data solutions, with hybrid work in the Sandton office and flexible arrangements. A strong SQL/Python skill set is essential.