Lead Data Engineer: Architect & Scale Data Pipelines

Placements24; Paarl; On-site; ZAR 1,200,000 - 2,000,000; Full time

Benefits offered by this job

Competitive salary

Medical aid

Retirement fund

Career advancement opportunities

Job summary

Placements24 in Paarl, Western Cape seeks a Lead Data Engineer to build and manage scalable data pipelines, warehousing, and data lakes. You will lead a team to ensure reliable ingestion, transformation, and storage for BI and advanced analytics.

The role requires a strong background in ETL/ELT, SQL, and big data tech, with leadership experience to mentor engineers and drive data strategy in a dynamic analytics firm.

Qualifications

• Bachelor's degree or higher in CS/Engineering or quantitative field.

Responsibilities

• Lead design, development, and maintenance of robust data pipelines (ETL/ELT).
• Architect and implement data warehousing and data lake solutions.
• Manage and optimize cloud-based data infrastructure (AWS/Azure/GCP).
• Ensure data quality, integrity, and security across systems.
• Develop data modeling best practices and governance.
• Collaborate with data scientists, analysts, and stakeholders to capture data requirements.
• Mentor and guide junior data engineers; promote best practices.
• Automate data processes and monitor pipeline performance.
• Evaluate and adopt new data technologies and tools.
• Troubleshoot and resolve data infrastructure issues.

Skills

Leadership

ETL design

SQL

Python/Scala

Big data technologies

Education

Bachelor's degree in CS/Engineering

Tools

Spark

Hadoop

Airflow

Luigi

AWS Redshift

S3

Glue

Azure Data Factory

BigQuery

Dataflow

Job description

Placements24 in Paarl, Western Cape seeks a Lead Data Engineer to build and manage scalable data pipelines, warehousing, and data lakes. You will lead a team to ensure reliable ingestion, transformation, and storage for BI and advanced analytics.

The role requires a strong background in ETL/ELT, SQL, and big data tech, with leadership experience to mentor engineers and drive data strategy in a dynamic analytics firm.