Data Engineer

Penta Consulting; Cape Town; On-site; ZAR 600,000 - 900,000; Full time

Job summary

Penta Consulting is seeking an experienced Data Engineer to design, develop, and maintain data pipelines, data warehouses and scalable data models to support BI and Analytics initiatives on a high-profile retail project.

You will work with Microsoft data technologies, Databricks and Python, ensuring data governance, security, testing and data quality across the data landscape.

Qualifications

• Experience designing and maintaining ETL/ELT pipelines.
• Experience with data warehouses and scalable data models.
• Strong understanding of data governance, security, testing and data quality.

Responsibilities

• Design, develop and maintain data pipelines and integration solutions
• Build and support enterprise data warehouse and scalable data models
• Develop and maintain ETL/ELT processes using Microsoft data technologies

Skills

MS SQL Server

Data pipelines

Python

Databricks

Data governance & security

BI tools exposure

Tools

Databricks

Power BI

Tableau

Pyramid Analytics

Job description

Penta Consulting are a technology service provider and leading outsourced partner helping to deliver professional and managed solutions across EMEA.

We are supporting a well esteemed client of ours searching for an experienced Data Engineer to play a key role in designing, developing, and maintaining data pipelines, data warehouses and scalable data models to support Business Intelligence and Analytics initiatives in a high-profile retail project.

Key responsibilities:

• Design, develop and maintain data pipelines and integration solutions
• Build and support enterprise data warehouse and scalable data models
• Develop and maintain ETL/ELT processes using Microsoft data technologies

We are looking for someone who has:

• Strong experience with Microsoft SQL Server
• Experience building and maintaining data pipelines
• Experience with Databricks and Python
• Strong understanding of Data Governance, security, testing and data quality processes
• Exposure to Business Intelligence, for example: Power BI, Tableau, and Pyramid Analytics