Senior Data Engineer - Big Data

Placements24; Sandton; Hybrid; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Competitive salary and incentives

Full remote work flexibility with a全球/

Job summary

Placements24 is seeking an experienced Senior Data Engineer to join our fully remote data team. You will design, build, and maintain scalable data pipelines and infrastructure to support analytics and machine learning initiatives.

You will work with Spark, Hadoop, Kafka and cloud services (AWS, Azure, GCP), ensuring data quality, availability and accessibility for data scientists and analysts. This remote role offers autonomy, a flexible schedule and the opportunity to contribute to impactful

Qualifications

• Bachelor's degree in Computer Science, Engineering or related field.
• 5+ years of data engineering experience.
• Strong Python or Scala skills.
• Hands-on with Spark, Hadoop.
• Experience with cloud data platforms (AWS, Azure, GCP) and services (S3, Redshift, BigQuery).
• Proficient in SQL and data warehousing concepts.

Responsibilities

• Design, build, and optimize data pipelines.
• Develop ETL/ELT processes for ingestion, transformation, and loading of data.
• Implement data quality checks and monitoring systems.
• Work with Spark, Hadoop, Kafka and cloud services.
• Collaborate with data scientists and analysts to understand data requirements.
• Maintain and improve data infrastructure for performance and cost-efficiency.

Skills

Python

Scala

SQL

Big Data

Apache Spark

Hadoop

Kafka

AWS

Azure

GCP

Data Warehousing

Education

Bachelor's degree in CS/Engineering or related field

Tools

Spark

Hadoop

Kafka

Job description

About the Role

Our client is actively searching for an experienced Senior Data Engineer to join their fully remote data team. This role is essential for designing, building, and maintaining scalable data pipelines and infrastructure that support sophisticated analytics and machine learning initiatives. You will work with massive datasets, ensuring data quality, availability, and accessibility for data scientists and analysts. This position offers the autonomy and flexibility of remote work, enabling you to contribute to impactful data projects from your chosen location. Join a forward-thinking company that values innovation and leverages data to drive strategic decisions.

Key Responsibilities

• Design, build, and optimize robust, scalable, and reliable data pipelines using big data technologies.
• Develop ETL/ELT processes to ingest, transform, and load data from diverse sources into data warehouses or data lakes.
• Implement data quality checks and monitoring systems to ensure data accuracy and consistency.
• Work with technologies such as Spark , Hadoop, Kafka, and cloud-based data services (e.g., AWS Redshift, Snowflake).
• Collaborate with data scientists and analysts to understand data requirements and provide efficient data solutions.
• Maintain and improve data infrastructure, ensuring optimal performance and cost-efficiency.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent experience.
• 5+ years of experience in data engineering or a related role.
• Strong proficiency in programming languages like Python or Scala .
• Hands‑on experience with big data technologies (e.g., Apache Spark, Hadoop ecosystem).
• Experience with cloud data platforms (e.g., AWS , Azure, GCP) and related services (e.g., S3, Redshift, BigQuery).
• Proficiency in SQL and data warehousing concepts.

Benefits

• Competitive salary and performance incentives.
• Comprehensive health, dental, and vision benefits.
• Full remote work flexibility with a global team.
• Generous allowance for professional development and training.
• Collaborative and intellectually stimulating remote work environment.
• Company-provided equipment and home office stipend.