Data Engineer (KG)

Mediro ICT Recruitment; Pretoria; On-site; ZAR 200,000 - 300,000; Full time

Job summary

A leading technology recruitment agency is seeking a Data Engineer based in Pretoria. The role involves the design, implementation, and management of data architecture, with a strong focus on data governance and reporting. Candidates should have 10-12 years of experience in data engineering, advanced SQL knowledge, and familiarity with data visualisation tools like Power BI. This contract position offers a competitive salary aligned with market standards.

Qualifications

• 10 - 12 years experience in a Data Engineering role building and optimising data pipelines, architectures, and data sets.
• Advanced working SQL knowledge and 5 years experience working with relational databases query authoring (SQL).
• Experience with a variety of databases technologies, languages, and visualisation engines (Power BI, Tableau, SAS).
• 3-4 years experience building analytics tools that utilise the data pipeline to provide actionable insights.

Responsibilities

• Deliver central data management governance and reporting within the Financial Surveillance Division.
• Design and implement data strategies and systems to create and maintain the data architecture.
• Build the infrastructure for optimal extraction, transformation, and loading of data from various sources.
• Collaborate with IT to source and load data into the data lake.
• Liaise between technical teams and business stakeholders to foster coordination.

Skills

Microsoft Power BI

Databases

Data Modelling

Data Engineering

Tableau

Relational Databases

Data Lakes

Performance Metrics

Data Pipelines

OBIEE

Informatica

Teradata

Apache Hive

S3

Hadoop

Redshift

Spark

AWS

Apache Pig

NoSQL

Big Data

Data Warehouse

Kafka

Scala

Education

Post-Graduate qualification (BSc Engineering or similar)

Job description

Introduction

My client whos responsible for ensuring the safety and soundness of the national payment system which is the backbone of South Africas modern nancial system presently has an exciting opportunity for a Data Engineer to joint their growing team based in Pretoria kindly submit all applications to

Job Description

The Data Engineer will work with our database architects data analysts and data scientists and will ensure optimal data architecture

and data governance is consistent throughout ongoing projects. The incumbent will also be responsible for transforming data into readable goal-driven reports / visual analytics solutions (e.g. Dashboards) for continued innovation and growth.

Objective of this Scope of Work

The incumbent will be responsible for delivering central data management governance and reporting within the Financial Surveillance Division (FinSurv) without impacting

operational procedures or systems. The successful candidate will be supporting projects and other initiatives that span across the organisation.

Designing and implementing data strategies and systemsto create and maintain the data architecture that will drive various initiatives across the organisation

Build infrastructure to automate extremely high volumes of data delivery and creatively solve data volume and scaling challenges. Contribute to the design and

architecture of innovative solutions to difficult problems.

Work with team and stakeholders to continually assess and redefine data technology stack to support changing data patterns and business use cases and to bridge the

gaps between Data teams and Business by constantly collaborating with all parties to understand data needs.

Build the infrastructure with IT which is required for optimal extraction transformation and loading of data from a wide variety of data sources using SQL and big data technologies.

Collaborate with IT to source and load a wide range of data across our business into the data lake so that it can be used by analysts and developers to develop data solutions for the business.

Develop and enhance the data ingestion framework using specified toolsets and will need to understand and continuously seek techniques to ingest data as well as ensure a high degree of quality and confidence

Assemble large complex data sets that meet functional / non-functional business requirements.

identify design and implement internal process improvements : automating manual processes optimising data delivery re-designing infrastructure for greater scalability etc.

Liaise between technical teams and specialists and business stakeholders fostering inter-departmental coordination and cooperation

Data Governance (Quality Accessibility Ownership and Security). Engage with stakeholders to obtain an understanding of their data practices to contract manage and meet expectations.

Identifies client data quality concerns conducts root cause analysis and provides feedback to the FinSurv Data Governance Board (DGB) and data management competency centres within the company.

Become a trusted advisor to stakeholders and influence decision making by providing an advisory service guidance and support on data quality practices

Maintaining a thorough understanding of the business and data strategy

Identify opportunities to influence the improvement or enhancement of business processes and methodologies by researching and recommending improvement initiatives and effective ways to operate and add value to.

Train other employees withon how to access the Data Ecosystem and how to make the best use of its contents.

Minimum Requirements

Minimum qualification Required :

An appropriate Post-Graduate qualification (BSc Engineering or similar).

Relevant programming qualifications and / or certifications

Relevant Agile certification is preferable

The following experience is required for this role :

10 - 12 years experience in a Data Engineering role building and optimising data pipelines architectures and data sets.

Constructing data acquisition warehousing and reporting solutions.

Advanced working SQL knowledge and 5 years experience working with relational databases query authoring (SQL)

Experience with a variety of databases technologies languages and visualisation engines (Power BI Tableau SAS)

3-4 years experience building analytics tools that utilise the data pipeline to provide actionable insights into customer management operational efficiency and other key business performance metrics.

Skills : Microsoft Power BI

Databases

Data Modelling

Data Engineering

Tableau

Relational Databases

Data Lakes

Performance Metrics

Data Pipelines

OBIEE

Informatica

Teradata

Competencies :

Analysis and problem solving

Effective communication

Planning and organising

Service and stakeholder focus

Conceptual thinking

Drive for results

Attention to detail

Package & Remuneration

Salary Market Related

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Contract

Experience : years

Vacancy : 1