Lead Data Engineer - Hybrid (Polokwane) - Scale Data Pipelines

Placements24; Polokwane; Hybrid; ZAR 900,000 - 1,800,000; Full time

Benefits offered by this job

Medical insurance

Life insurance

Retirement fund

Bonuses

Leadership training

Hybrid work Polokwane

Job summary

Placements24 is seeking an experienced Lead Data Engineer for a hybrid role based in Polokwane to design, develop, and maintain scalable data infrastructure for a major e-commerce analytics client.

You will lead a team of data engineers, build robust data pipelines, and collaborate with data scientists and business stakeholders to deliver high-quality analytics, BI, and ML initiatives in a hybrid work setup.

Qualifications

• 7+ years in data engineering, with at least 3 years in a lead/senior capacity.
• Strong proficiency in SQL and experience with relational and NoSQL databases.
• Hands-on experience with Spark, Hadoop, Flink, or similar big data frameworks.
• Expertise building ETL/ELT pipelines using Airflow, Kafka, or equivalent.
• Experience with cloud data platforms (AWS/Azure/GCP).
• Proficiency in Python/Scala/Java for data tooling.
• Understanding of data warehousing concepts and data modeling.
• Experience with data governance and data quality frameworks.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Develop and optimize data warehousing solutions and data lakes.
• Oversee big data tech (Spark, Hadoop ecosystem) implementation.
• Ensure data quality, integrity, and consistency across platforms.
• Collaborate with data scientists, analysts, and stakeholders to meet data needs.
• Lead and mentor a team of data engineers, promoting best practices.
• Implement data governance and ensure privacy compliance.
• Automate data processes and monitor performance to resolve bottlenecks.
• Evaluate new data technologies to enhance infrastructure.
• Contribute to the architectural roadmap and document pipelines.

Skills

SQL

Spark

Hadoop

Airflow

Kafka

Python

Scala/Java

Leadership

NoSQL

Data modeling

Education

Master's degree in CS/Engineering

Equivalent experience

Tools

Cloud platforms (AWS/Azure/GCP)

Job description

Placements24 is seeking an experienced Lead Data Engineer for a hybrid role based in Polokwane to design, develop, and maintain scalable data infrastructure for a major e-commerce analytics client.

You will lead a team of data engineers, build robust data pipelines, and collaborate with data scientists and business stakeholders to deliver high-quality analytics, BI, and ML initiatives in a hybrid work setup.