Lead Data Engineer

Placements24; Vereeniging; On-site; ZAR 1,000,000 - 1,800,000; Full time

Benefits offered by this job

Annual bonus

Medical coverage

Retirement fund

Job summary

Placements24 is seeking a Lead Data Engineer in Vereeniging, Gauteng, to build and manage a scalable data infrastructure for a fast-growing fintech. You will design, implement, and optimize data pipelines, warehousing, and modeling while ensuring data quality and accessibility for analytics and ML teams.

You will mentor junior engineers, drive best practices, and shape the company data strategy, collaborating with data scientists, analysts and stakeholders across the organization.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
• Minimum of 6 years of experience in data engineering, data warehousing, or related role.
• Proven expertise with large-scale data pipelines using Spark, Kafka, or Flink.
• Strong proficiency in SQL and experience with PostgreSQL, MySQL, or NoSQL databases.
• Experience with cloud platforms (AWS, Azure, GCP) and data services (S3, Redshift, BigQuery).
• Proficiency in Python or Scala and knowledge of dimensional modeling.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes.
• Develop and optimize data warehousing solutions for BI and analytics.
• Implement and manage data modeling for structured and unstructured data.
• Ensure data quality, integrity, and reliability across systems.
• Collaborate with data scientists, analysts, and stakeholders to understand data needs.
• Develop data governance policies and monitor performance; mentor junior engineers.

Skills

Data pipelines design

SQL

Python

Scala

Leadership

Data governance

Communication

Education

Bachelor's or Master's in CS/Engineering or related field

Tools

Apache Spark

Kafka

Flink

AWS/GCP/Azure data services

BigQuery/Redshift/S3

Job description

About the Role

Our client, a fast-growing fintech company, is seeking a highly skilled and experienced Lead Data Engineer to build and manage their data infrastructure. This critical role is based at their modern offices in Vereeniging, Gauteng, ZA , and will involve designing, constructing, installing, testing, and maintaining highly scalable data management systems. You will be responsible for developing data pipelines, ensuring data quality, and enabling efficient data access for analytics and machine learning teams. As a leader, you will mentor junior engineers and drive best practices in data engineering, playing a pivotal role in shaping the company's data strategy.

Key Responsibilities

Design, build, and maintain robust, scalable, and efficient data pipelines and ETL processes. Develop and optimize data warehousing solutions to support business intelligence and analytics needs. Implement and manage data modeling strategies for structured and unstructured data. Ensure the quality, integrity, and reliability of data across all systems. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements. Develop and maintain data governance policies and procedures. Monitor data infrastructure performance, troubleshoot issues, and implement optimizations. Evaluate and recommend new data technologies and tools to enhance capabilities. Mentor and guide junior data engineers, fostering a culture of technical excellence. Ensure data security and compliance with relevant regulations.

Requirements

Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field. Minimum of 6 years of experience in data engineering, data warehousing, or a related role. Proven expertise in designing and implementing large‑scale data pipelines using tools like Apache Spark, Kafka, or Flink. Strong proficiency in SQL and experience with various database technologies (e.g., PostgreSQL, MySQL, NoSQL databases). Experience with cloud platforms (AWS, Azure, GCP) and their data services (e.g., S3, Redshift, BigQuery, Data Lake Storage). Proficiency in programming languages commonly used in data engineering, such as Python or Scala. Familiarity with data warehousing concepts and dimensional modeling. Experience with ETL tools and frameworks. Excellent problem‑solving, analytical, and communication skills. Leadership experience or strong mentorship capabilities.

Benefits

Our client offers a very competitive salary package, annual bonuses, comprehensive medical coverage, and an attractive retirement fund. They are committed to professional development, providing ample opportunities for training, attending industry conferences, and acquiring new certifications. The collaborative work environment fosters innovation, and you will have access to cutting‑edge data technologies. This role is based in Vereeniging, Gauteng, ZA , offering a stable and rewarding career.