Data Engineer: Scalable Pipelines & Insights (Cape Town)

Salix Recruitment; Wes-Kaap; On-site; ZAR 700,000 - 900,000; Full time

Job summary

A proudly South African food processing company is seeking an experienced Data Engineer to join its IT team in Cape Town. You will design, develop and maintain scalable data pipelines and cloud-based data solutions to enable business intelligence, analytics, automation and data-driven decision-making.

You will work with BI, Analytics and business teams to translate requirements into technical solutions, while ensuring data quality, governance and performance.

Qualifications

• 3–5 years of hands-on experience in data engineering, data warehousing or a related role.
• Experience with Microsoft Fabric, Azure Data Services or equivalent cloud data platforms.
• Strong SQL skills and knowledge of data modelling.
• Experience developing ETL/ELT pipelines using modern data engineering tools.
• Working knowledge of Microsoft Fabric, including Data Factory, Lakehouse and Warehouse, or equivalent technologies.
• Experience with Python, Spark or similar data processing technologies.
• Understanding of cloud data architectures, APIs and system integrations.

Responsibilities

• Design, build and maintain scalable batch and near-real-time data pipelines.
• Develop and optimise ETL/ELT processes for data ingestion, cleansing, transformation and modelling.
• Build and maintain data warehouse and lakehouse architectures.
• Develop analytical and dimensional data models to support reporting and BI.
• Implement data quality controls, validation processes, governance and security standards.
• Monitor and optimise data pipeline performance, reliability and cost efficiency.
• Collaborate with BI analysts, data scientists and business stakeholders to deliver data solutions.
• Troubleshoot data issues and drive continuous improvement.

Skills

SQL

Data modelling

Python/Spark

ETL/ELT pipelines

Education

Bachelor's degree in Computer Science, Information Technology, Engineering or a related field

Tools

Microsoft Fabric

Azure Data Services

Data Factory

Lakehouse

Job description

A proudly South African food processing company is seeking an experienced Data Engineer to join its IT team in Cape Town. You will design, develop and maintain scalable data pipelines and cloud-based data solutions to enable business intelligence, analytics, automation and data-driven decision-making.

You will work with BI, Analytics and business teams to translate requirements into technical solutions, while ensuring data quality, governance and performance.