Cloud Data Engineer - Pipelines, Lakehouse & Analytics

TFG (The Foschini Group); Wes-Kaap; On-site; ZAR 900,000 - 1,200,000; Full time

Job summary

TFG (The Foschini Group) is seeking a Data Engineer to design, implement and maintain the data infrastructure for our Insights team. You will collaborate with Engineering Leads, Data Architects and stakeholders to ensure data is properly sourced, stored and accessible for analysis.

The role focuses on ETL, data modelling, lakehouse/Databricks, data governance and the creation of dashboards. You will optimize pipelines, enable real-time processing, and deliver scalable data solutions that drive

Qualifications

• Minimum 3 years in IT or related qualification.
• 3+ years data pipeline design and development experience.
• Proficiency in Python and SQL.
• Experience with SQL Server, MySQL and PostgreSQL.
• Automation scripting with PowerShell, Bash, or Python.
• Experience with unit and integration tests.
• Experience with PowerBI, Tableau or Pyramid Analytics.
• Strong analytical/problem solving skills.

Responsibilities

• Design, develop, test and maintain data pipelines (ETL) into data warehouses/lakes.
• Implement data quality and validation checks for accuracy and completeness.
• Optimize and scale data processing and storage for high concurrency.
• Troubleshoot data pipelines and perform root cause analysis.
• Develop and maintain documentation for data pipelines and processes.

Skills

Databricks

Python

SQL

Data modelling

Education

IT qualification

Tools

Azure

Git

CI/CD

Docker

Job description

TFG (The Foschini Group) is seeking a Data Engineer to design, implement and maintain the data infrastructure for our Insights team. You will collaborate with Engineering Leads, Data Architects and stakeholders to ensure data is properly sourced, stored and accessible for analysis.

The role focuses on ETL, data modelling, lakehouse/Databricks, data governance and the creation of dashboards. You will optimize pipelines, enable real-time processing, and deliver scalable data solutions that drive