Data Engineer

Interfront Soc Ltd.; Pretoria; Hybrid; ZAR 200 000 - 300 000; Part time

Job summary

A dynamic technology firm is seeking a Data Engineer for a 6-month contract role based in Gauteng. Key responsibilities include designing and optimizing T-SQL procedures, developing ETL workflows, and collaborating with cross-functional teams. This hybrid position is open to individuals with disabilities.

Responsibilities

• Design, build, and optimize T-SQL stored procedures for data processing.
• Develop and monitor ETL workflows using SQL Server Agent or Azure Data Factory.
• Perform data cleansing and transformation for business intelligence workflows.
• Engineer and maintain feature store tables for ML models.
• Prepare datasets for downstream consumption in Power BI dashboards.
• Implement data validation and QA frameworks.
• Enforce data security and compliance controls.
• Collaborate with data teams to translate problems into data solutions.

Job description

Key Responsibilities

Data Engineering & Pipeline Management

• Design, build, and optimize T‑SQL stored procedures, functions, and scripts for high-volume data processing and ECM scoring.
• Develop, deploy, and monitor end‑to‑end ETL / ELT workflows (e.g., SQL Server Agent, SSIS, Azure Data Factory, or Airflow) with checkpoint / rollback, jobtracking, and recovery capabilities.
• Perform data cleansing, preparation, and transformation to support business intelligence and machine learning workflows.
• Engineer and maintain reusable feature store tables (per entity / tax type) for ML models and operational scoring.
• Model and maintain data warehouse structures (3NF, dimensional / star / snowflake), ensuring proper documentation of data lineage.
• Prepare and deliver curated, scored datasets for downstream consumption in Power BI dashboards and analytics environments.
• Develop and maintain audit, telemetry, and job tracking tables to ensure data reliability, restartability, and monitoring visibility.
• Support and troubleshoot production pipelines, optimizing query performance via indexing, tuning, and profiling tools.

Data Quality, Governance, and Compliance

• Implement and monitor data validation, reconciliation, and QA frameworks across the data lifecycle.
• Enforce data security, privacy, and compliance controls in line with corporate and regulatory standards.
• Support the implementation of data governance and lineage documentation, ensuring traceability and adherence to EDM policies.

Collaboration and Cross‑functional Support

• Collaborate with data analysts, data scientists, software engineers, and business stakeholders to translate business problems into scalable data solutions.
• Provide accessible, well‑documented datasets to support analytics and reporting.
• Contribute to all phases of the SDLC, including requirements, design, development, testing, deployment, and maintenance.

Closing date: 12th of November 2025

Position type: 6 months contract

Available positions: 2

Hybrid position and successful candidate must be based in Gauteng area

These positions are open to persons with disabilities.