Senior Data Engineer: Build Scalable Cloud Data Pipelines

Network Contracting; Gauteng; On-site; ZAR 600,000 - 1,000,000; Full time

Job summary

Network Contracting in Gauteng, South Africa, is seeking a Senior Data Engineer to design and maintain scalable data pipelines. You will build ETL/ELT processes, ingest data, model data, and ensure data quality while collaborating with data science and software teams.

The role requires strong Python and SQL skills, experience with cloud data platforms such as AWS/Azure, and working with large datasets. The candidate will automate data workflows and optimize performance.

Qualifications

• 5+ years of data engineering experience.
• Strong experience with SQL.
• Strong experience with Python.
• Experience developing ETL/ELT pipelines.
• Experience working with cloud data platforms.
• Experience working with large datasets.

Responsibilities

• Design, develop and maintain scalable data pipelines.
• Build and optimise ETL and ELT processes.
• Develop data ingestion and integration solutions.
• Develop and maintain data models.
• Implement data quality and validation processes.
• Optimise data processing and pipeline performance.
• Collaborate with Data Scientists, BI Developers and Software Engineers.
• Work with cloud-based data platforms.
• Automate data engineering processes.
• Troubleshoot data pipeline and integration issues.

Skills

Python

SQL

ETL / ELT

Data Warehousing

AWS/Azure

Data Modelling

Apache Spark

Education

BSc / BCom / Diploma in CS/IT/Data Engineering

Cloud or data certifications

Tools

Azure Data Factory

Apache Spark

Job description

Network Contracting in Gauteng, South Africa, is seeking a Senior Data Engineer to design and maintain scalable data pipelines. You will build ETL/ELT processes, ingest data, model data, and ensure data quality while collaborating with data science and software teams.

The role requires strong Python and SQL skills, experience with cloud data platforms such as AWS/Azure, and working with large datasets. The candidate will automate data workflows and optimize performance.