Senior Data Engineer - Remote Big Data Pipelines

Placements24; Sandton; Hybrid; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Competitive salary and incentives

Full remote work flexibility with a全球/

Job summary

Placements24 is seeking an experienced Senior Data Engineer to join our fully remote data team. You will design, build, and maintain scalable data pipelines and infrastructure to support analytics and machine learning initiatives.

You will work with Spark, Hadoop, Kafka and cloud services (AWS, Azure, GCP), ensuring data quality, availability and accessibility for data scientists and analysts. This remote role offers autonomy, a flexible schedule and the opportunity to contribute to impactful

Qualifications

• Bachelor's degree in Computer Science, Engineering or related field.
• 5+ years of data engineering experience.
• Strong Python or Scala skills.
• Hands-on with Spark, Hadoop.
• Experience with cloud data platforms (AWS, Azure, GCP) and services (S3, Redshift, BigQuery).
• Proficient in SQL and data warehousing concepts.

Responsibilities

• Design, build, and optimize data pipelines.
• Develop ETL/ELT processes for ingestion, transformation, and loading of data.
• Implement data quality checks and monitoring systems.
• Work with Spark, Hadoop, Kafka and cloud services.
• Collaborate with data scientists and analysts to understand data requirements.
• Maintain and improve data infrastructure for performance and cost-efficiency.

Skills

Python

Scala

SQL

Big Data

Apache Spark

Hadoop

Kafka

AWS

Azure

GCP

Data Warehousing

Education

Bachelor's degree in CS/Engineering or related field

Tools

Spark

Hadoop

Kafka

Job description

Placements24 is seeking an experienced Senior Data Engineer to join our fully remote data team. You will design, build, and maintain scalable data pipelines and infrastructure to support analytics and machine learning initiatives.

You will work with Spark, Hadoop, Kafka and cloud services (AWS, Azure, GCP), ensuring data quality, availability and accessibility for data scientists and analysts. This remote role offers autonomy, a flexible schedule and the opportunity to contribute to impactful