Senior Data Engineer

Network Contracting; Gauteng; On-site; ZAR 600,000 - 1,000,000; Full time

Job summary

Network Contracting in Gauteng, South Africa, is seeking a Senior Data Engineer to design and maintain scalable data pipelines. You will build ETL/ELT processes, ingest data, model data, and ensure data quality while collaborating with data science and software teams.

The role requires strong Python and SQL skills, experience with cloud data platforms such as AWS/Azure, and working with large datasets. The candidate will automate data workflows and optimize performance.

Qualifications

• 5+ years of data engineering experience.
• Strong experience with SQL.
• Strong experience with Python.
• Experience developing ETL/ELT pipelines.
• Experience working with cloud data platforms.
• Experience working with large datasets.

Responsibilities

• Design, develop and maintain scalable data pipelines.
• Build and optimise ETL and ELT processes.
• Develop data ingestion and integration solutions.
• Develop and maintain data models.
• Implement data quality and validation processes.
• Optimise data processing and pipeline performance.
• Collaborate with Data Scientists, BI Developers and Software Engineers.
• Work with cloud-based data platforms.
• Automate data engineering processes.
• Troubleshoot data pipeline and integration issues.

Skills

Python

SQL

ETL / ELT

Data Warehousing

AWS/Azure

Data Modelling

Apache Spark

Education

BSc / BCom / Diploma in CS/IT/Data Engineering

Cloud or data certifications

Tools

Azure Data Factory

Apache Spark

Job description

We are currently building our IT talent database and are looking to connect with experienced Senior Data Engineers for current and future opportunities. We are particularly interested in professionals with strong experience in Python, SQL, ETL/ELT, data warehousing and cloud data platforms. This is an opportunity to register your profile with us so that your data engineering experience can be considered for suitable opportunities as they become available. If you enjoy solving complex data challenges and engineering high-quality data solutions, we'd love to hear from you.

Key Responsibilities:

• Design, develop and maintain scalable data pipelines.
• Build and optimise ETL and ELT processes.
• Develop data ingestion and integration solutions.
• Develop and maintain data models.
• Implement data quality and validation processes.
• Optimise data processing and pipeline performance.
• Collaborate with Data Scientists, BI Developers and Software Engineers.
• Work with cloud-based data platforms.
• Automate data engineering processes.
• Troubleshoot data pipeline and integration issues.

Job Experience & Skills Required / Ideal Candidate Profile:

Education

• BSc, BCom, Diploma or equivalent qualification in Computer Science, Information Technology, Data Engineering or a related field will be advantageous.
• Relevant cloud or data certifications will be advantageous.

Experience

• 5+ years of data engineering experience.
• Strong experience with SQL.
• Strong experience with Python.
• Experience developing ETL/ELT pipelines.
• Experience working with cloud data platforms.
• Experience working with large datasets.

Skills

• Python
• SQL
• ETL / ELT.
• Data Warehousing.
• AWS and/or Azure.
• Data Modelling.
• Azure Data Factory.
• Apache Spark.

Location: Gauteng