Senior Big Data Engineer: ETL, Data Lakes & Analytics

Placements24; Klerksdorp; On-site; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Competitive salary & benefits

Challenging big data projects in Klerk

Health, dental, and vision insurance

Paid time off & retirement plan

Learning & development support

Job summary

Placements24 in Klerksdorp is seeking a Senior Data Engineer to design and implement robust big data infrastructure. You will build and maintain data pipelines, ensure data quality, and enable analytics and machine learning initiatives.

You will work with large datasets, optimize frameworks such as Spark and Hadoop, and collaborate with data scientists and analysts to deliver reliable data solutions and governance.

Qualifications

• Minimum of 5 years of data engineering experience.
• Proven experience with Spark, Hadoop, Kafka or Flink.
• Strong SQL and Python or Scala.
• Experience with AWS Redshift, Snowflake or BigQuery.
• Solid understanding of data warehousing concepts.

Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines using big data tech.
• Develop data warehousing and data lake solutions to support BI.
• Optimize processing frameworks for performance and cost.
• Ensure data quality, integrity, and security across platforms.
• Collaborate with data scientists and analysts to meet data needs.
• Implement data governance to maintain compliance and integrity.

Skills

Spark

Hadoop

Kafka

Flink

SQL

Python

Scala

AWS Redshift

Snowflake

BigQuery

Job description

Placements24 in Klerksdorp is seeking a Senior Data Engineer to design and implement robust big data infrastructure. You will build and maintain data pipelines, ensure data quality, and enable analytics and machine learning initiatives.

You will work with large datasets, optimize frameworks such as Spark and Hadoop, and collaborate with data scientists and analysts to deliver reliable data solutions and governance.