Senior Data Engineer: Scalable Big Data Pipelines (Hybrid)

Placements24; Randburg; Hybrid; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Competitive salary and annual bonus

Medical, dental, and vision benefits

Retirement savings plan with employer

Training and professional development

Hybrid work environment

Job summary

Placements24 in Randburg is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that support analytics, BI, and machine learning initiatives.

You will work with large datasets and modern big data technologies (Spark, Hadoop, Kafka) on cloud platforms, collaborating with data scientists and business stakeholders to translate raw data into reliable insights and business value.

Qualifications

• Degree in a quantitative field as listed.
• 5+ years in data engineering or related roles.
• Strong SQL and data warehousing experience.
• Hands-on with Spark, Hadoop, Kafka or similar.
• Proficient in Python or Scala and cloud platforms.

Responsibilities

• Design, construct, install, test, and maintain scalable data pipelines.
• Develop ETL/ELT processes for data ingestion and transformation.
• Optimize data processing for performance and cost.
• Collaborate with data scientists, analysts, and stakeholders.
• Ensure data quality, integrity, and security.
• Build data models to support reporting and ML applications.

Skills

SQL proficiency

Python/Scala programming

Data modeling

Education

Bachelor's or Master's in CS/Engineering/Statistics

Tools

Apache Spark

Hadoop

Kafka

NoSQL databases

Job description

Placements24 in Randburg is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that support analytics, BI, and machine learning initiatives.

You will work with large datasets and modern big data technologies (Spark, Hadoop, Kafka) on cloud platforms, collaborating with data scientists and business stakeholders to translate raw data into reliable insights and business value.