Senior Data Engineer - Cloud Platforms (Benoni)

Placements24; Benoni; On-site; ZAR 900,000 - 1,200,000; Full time

Benefits offered by this job

Competitive salary

Performance-based bonuses

Health, dental, and vision benefits

Retirement savings plan

Paid time off

Job summary

Placements24 in Benoni, South Africa, is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure. You will transform raw data into actionable insights to support BI and ML initiatives, in a modern office setting.

The ideal candidate has 5+ years in data engineering, strong cloud data services (AWS/Azure/GCP), and expert Python/Scala/Java skills with Spark and Hadoop. Collaboration with data scientists and business stakeholders is essential.

Qualifications

• Requires degree in a quantitative field and 5+ years in data engineering.
• Strong cloud data services experience (AWS/Azure/GCP) and BI/ML support knowledge.
• Proficiency in Python/Scala/Java with Spark and Hadoop experience.

Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL/ELT processes.
• Build and maintain data warehouses and data lakes on cloud platforms.
• Implement data governance and data quality best practices.
• Collaborate with data scientists, analysts, and stakeholders to define data requirements.
• Develop and manage infrastructure for big data processing (Spark, Kafka, Flink).
• Monitor performance, troubleshoot, and ensure high availability and efficiency.
• Automate data processes and deployments using CI/CD concepts.
• Stay current with emerging data technologies and document standards.
• Contribute to architectural design of data platforms.

Skills

Analytical thinking

Communication skills

Team collaboration

Agile development

Education

Bachelor's degree in Computer Science / Engineering / IT

Master's degree is a plus

Tools

Python

Scala

Java

Apache Spark

Apache Hadoop

Airflow

Databricks

SQL

Cloud data services

Job description

Placements24 in Benoni, South Africa, is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure. You will transform raw data into actionable insights to support BI and ML initiatives, in a modern office setting.

The ideal candidate has 5+ years in data engineering, strong cloud data services (AWS/Azure/GCP), and expert Python/Scala/Java skills with Spark and Hadoop. Collaboration with data scientists and business stakeholders is essential.