Data Engineer

Digital Spaces Allegiance; Pretoria; On-site; ZAR 700 000 - 900 000; Full time

Job summary

A data services company is seeking a Data Engineer for a 6-month contract in Pretoria, South Africa. The role involves designing ETL workflows, ensuring data quality, and collaborating with cross-functional teams. Ideal candidates will have strong SQL and data warehousing experience, along with a background in data governance. This opportunity offers a chance to enhance production data solutions in a dynamic environment.

Qualifications

• 6-8 years of experience in data engineering or data management in production environments.
• Advanced T-SQL development and performance tuning experience.
• Proven delivery of production data solutions in enterprise environments.

Responsibilities

• Design and optimize T-SQL stored procedures and scripts.
• Develop and monitor end-to-end ETL/ELT workflows.
• Prepare curated datasets for downstream consumption in Power BI.

Skills

T-SQL

ETL/ELT workflows

Data warehousing

Cloud-based data architectures

Data governance

Power BI

Education

Tertiary qualification in Computer Science or related field

Tools

SQL Server

Azure Data Factory

SSIS

Airflow

Git

Job description

Our Client is looking for a Data Engineer for a 6-month contract

Key Responsibilities

Data Engineering & Pipeline Management

• Design, build, and optimize T-SQL stored procedures, functions, and scripts for high-volume data processing and ECM scoring.
• Develop, deploy, and monitor end-to-end ETL / ELT workflows (e.g., SQL Server Agent, SSIS, Azure Data Factory, or Airflow) with checkpoint / rollback, jobtracking, and recovery capabilities.
• Perform data cleansing, preparation, and transformation to support business intelligence and machine learning workflows.
• Engineer and maintain reusable feature store tables (per entity / tax type) for ML models and operational scoring.
• Model and maintain data warehouse structures (3NF, dimensional / star / snowflake), ensuring proper documentation of data lineage.
• Prepare and deliver curated, scored datasets for downstream consumption in Power BI dashboards and analytics environments.
• Develop and maintain audit, telemetry, and job tracking tables to ensure data reliability, restartability, and monitoring visibility.
• Support and troubleshoot production pipelines, optimizing query performance via indexing, tuning, and profiling tools.

Data Quality, Governance, and Compliance

• Implement and monitor data validation, reconciliation, and QA frameworks across the data lifecycle.
• Enforce data security, privacy, and compliance controls in line with corporate and regulatory standards.
• Support the implementation of data governance and lineage documentation, ensuring traceability and adherence to EDM policies.

Collaboration and Cross-functional Support

• Collaborate with data analysts, data scientists, software engineers, and business stakeholders to translate business problems into scalable data solutions.
• Provide accessible, well-documented datasets to support analytics and reporting.
• Contribute to all phases of the SDLC, including requirements, design, development, testing, deployment, and maintenance.

Qualifications and Experience

• A tertiary qualification in Computer Science, Information Systems, Data Engineering, Analytics, mathematics, or statistics, or matric with 6-8 years of experience in data engineering, database development, or data management in production environments.
• Proven hands-on experience with SQL Server, including advanced T-SQL development, ETL / ELT workflow design, and performance tuning.
• Demonstrated delivery of production data solutions—both batch and near real-time—within enterprise environments.
• Experience in building and maintaining data warehouses, feature stores, and reusable data products.
• Track record of implementing data governance and quality frameworks, ensuring compliance and traceability.
• Experience in orchestrating complex data pipelines using SQL Server Agent, SSIS, Airflow, or Azure Data Factory.
• Familiarity with cloud-based data architectures (Azure preferred) and version control systems (Git).
• Exposure to Power BI or equivalent visualization tools for reporting and analytics enablement.
• Strong understanding of data security, privacy, and regulatory compliance requirements.