Data Engineer (Business Intelligence)

DLK Group; Cape Town; On-site; ZAR 200 000 - 300 000; Full time

Job summary

A dynamic data solutions company is seeking a Senior Data Engineer to design and maintain scalable data pipelines and infrastructure. The role involves translating business needs into technical solutions using Azure Data Factory and Power BI. Ideal candidates should have a Bachelor's degree in a relevant field and practical experience with data warehousing and cloud platforms. Responsibilities include monitoring pipeline performance, optimizing solutions, and supporting business intelligence needs.

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, or related field.
• Relevant postgraduate qualification will be advantageous.
• Microsoft Azure certifications preferred.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Translate business requirements into technical data solutions.
• Monitor data pipelines for performance and optimize as needed.

Skills

Data Warehouse Life Cycle understanding

DAX queries

ETL/Data Pipeline Architecture

Cloud Platforms

TSQL

PowerBI reporting

Education

Bachelor’s degree in Computer Science or related field

Postgraduate qualification

Tools

Azure Data Factory

Power BI Fabric

Job description

The Senior Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and data infrastructure to support data-intensive applications and analytics solutions using Azure Data Factory and Power BI Fabric. The role involves developing and optimising data pipelines, Power BI semantic models, and reports, as well as designing robust data architectures and overseeing data engineering initiatives. Working closely with cross-functional teams, the Data Engineer contributes to the strategic direction of data platforms, ensuring reliable, high-quality data to support business intelligence and analytics needs.

Key Responsibilities and Skills

• Translate business requirements into technical data solutions
• Understanding and practical experience in the Data Warehouse Life Cycle.
• Participate in and contribute to architectural forums within WCG BI team
• Data modelling (Dimensional, multi-dimensional and Relational)
• ETL/Data Pipeline Architecture and implementation.
• Process Automation and Architecture.
• Understanding of DAX queries and Cubes (semantic models).
• Data integration between legacy and modern systems.
• Interface with users to understand and agree on specifications
• Ad-hoc scripts to facilitate user queries
• Cloud Platforms: Deploy and manage data solutions on cloud platforms such as Azure
Batch scheduling
• TSQL (for database management and querying)
• Documentation: Create and maintain technical documentation, including data architecture diagrams, ETL workflows, and system documentation, to facilitate understanding and maintainli>
• Participate in design, peer and code reviews
• Daily technical, functional and operation support for existing Business Intelligence solutions.
• Monitoring, Optimization and Troubleshooting: Monitor data pipelines and infrastructure performance, identify bottlenecks and optimize for scalability, reliability, and cost-efficiency. Troubleshoot and fix data-related issues.
• Contribute to the ideology and growth of moving the architecture to modern platforms, on-premise and/or cloud.
• Working knowledge of PowerBI reporting.
• Ensure technical skills remain relevant to emerging industry or organisational technical strategies e.g. Azure Cloud Solutions, Artificial Intelligence initiatives.

Requirements

Qualifications:

• Bachelor’s degree in Computer Science, Information Systems, Engineering, Data Science, or a related field
• Relevant postgraduate qualification (Honours or Master’s) will be advantageous
• Microsoft Azure certifications such as:
• Azure Data Engineer Associate (DP-203)
• Azure Fundamentals (AZ-900)
• Strong practical experience with Azure Data Factory and Power BI Fabric