Senior Data Engineer

e-Merge IT Recruitment; Johannesburg; Hybrid; ZAR 810.000 - 990.000; Vollzeit

Benefits dieser Stelle

Hybrid work model

Zusammenfassung

e-Merge IT Recruitment is seeking a Senior Data Engineer in Johannesburg to design, build and maintain scalable data solutions. You will work on ETL/ELT pipelines, data warehouses and modern data platforms, while integrating data from diverse sources and ensuring data quality and security.

The role requires 5+ years in Data Engineering, strong SQL and Python, and experience with cloud databases and orchestration tools. Hybrid work setup with competitive R900k CTC.

Qualifikationen

• 5+ years' experience in Data Engineering or a related role.
• Strong SQL and Python skills.
• Proven ETL/ELT and data integration experience.
• Experience with relational and/or cloud databases.
• Strong understanding of data warehousing and dimensional modelling.
• Exposure to AWS, Azure or GCP.
• Experience with orchestration tools and Git.
• Advantageous: Azure Data Factory / AWS Glue / Databricks / Snowflake / Microsoft Fabric Power BI / Apache Spark / Kafka /Docker / Kubernetes

Aufgaben

• Design, develop and maintain scalable ETL/ELT pipelines for reliable data processing.
• Build, enhance and optimise data warehouses and modern data platforms.
• Integrate and consolidate data from diverse sources and systems.
• Develop high-performance SQL queries and efficient data transformation processes.
• Maintain high standards of data quality, governance, security and availability.
• Monitor, troubleshoot and optimise data pipelines and workflows.
• Collaborate with Data Analysts, BI Developers, Software Engineers and business stakeholders to deliver data solutions.
• Contribute to data architecture, automation and engineering best practices.
• Develop and support cloud-based data solutions to enable scalable data processing.

Kenntnisse

SQL

Python

ETL/ELT

Data integration

Data warehousing

Dimensional modelling

Cloud platforms AWS/Azure/GCP

Git

Data quality governance

Azure Data Factory

AWS Glue

Databricks

Snowflake

Kafka

Docker

Kubernetes

Apache Spark

Power BI

Tools

Databricks

Snowflake

Power BI

Git

Docker

Kubernetes

Jobbeschreibung

Senior Data Engineer - Johannesburg - up to R900k per annum

A large marketing data generation and distribution company, transforming how businesses access, manage and use data - are rapidly expanding their footprint globally.

They are looking for an experienced Senior Data Engineer to join their technology team and play a key role in designing, building and maintaining scalable, reliable data solutions.

Responsibilities:

• Design, develop and maintain scalableETL/ELT pipelinesfor reliable data processing.
• Build, enhance and optimisedata warehouses and modern data platforms.
• Integrate and consolidate data from diverse sources and systems.
• Develop high-performanceSQL queriesand efficient data transformation processes.
• Maintain high standards ofdata quality, governance, security and availability.
• Monitor, troubleshoot and continuously optimise data pipelines and workflows.
• Collaborate withData Analysts, BI Developers, Software Engineers and business stakeholdersto deliver effective data solutions.
• Contribute todata architecture, automation and engineering best practices.
• Develop and supportcloud-based data solutionsto enable scalable and efficient data processing.

Qualifications & Experience:

• 5+ years' experiencein Data Engineering or a related role.
• StrongSQLandPythonskills.
• Proven ETL/ELT and data integration experience.
• Experience with relational and/or cloud databases.
• Strong understanding of data warehousing and dimensional modelling.
• Exposure toAWS, Azure or GCP.
• Experience with orchestration tools andGit.
• Understanding of data quality, governance and software engineering practices.
• Advantageous: Azure Data Factory / AWS Glue /Databricks / Snowflake / Microsoft Fabric Power BI / Apache Spark /Kafka /Docker / Kubernetes

The Reference Numberfor this position isNG61504which is a Permanent, Hybrid position based in the Johannesburg offering a cost to company of up to R900k CTC negotiable on experience and ability. Contact Nokuthula at [e-mail] or call her on 011 463 3633 to discuss this and other opportunities.