Data Engineer: Big Data & Cloud Analytics (Hybrid)

Placements24; Durban; Hybrid; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Hybrid work arrangement

Health insurance

Learning and development

Job summary

Placements24 in Durban is seeking a Data Engineer to build and maintain scalable data infrastructure, enabling data‑driven insights across the organization. You will design, test, install and optimize ETL/ELT pipelines, data models, and data warehousing, collaborating with data scientists and analysts in a hybrid work environment.

The role requires a Bachelor's degree in CS/Engineering and 3+ years of experience, with proficiency in SQL, Spark, Hadoop, Kafka, and cloud data platforms.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 3+ years of experience as a Data Engineer or similar role.
• Proficiency in SQL and experience with relational and NoSQL databases.
• Hands-on experience with big data technologies such as Apache Spark, Hadoop, Kafka, or similar.
• Experience with cloud data platforms (e.g., AWS Redshift, Azure Data Lake, Google BigQuery).
• Strong programming skills in Python or Scala.

Responsibilities

• Design, build, and maintain scalable and reliable ETL/ELT pipelines for batch and real-time data processing.
• Develop and optimize data models and database schemas for performance and analytical use cases.
• Implement data warehousing solutions and manage large datasets using distributed computing frameworks.
• Ensure data quality, integrity, and security across all data platforms.
• Collaborate with data scientists and analysts to understand their data requirements and provide accessible data solutions.
• Monitor data systems, troubleshoot issues, and implement performance improvements.

Skills

SQL

NoSQL

Python

Scala

ETL/ELT pipelines

Data modeling

Big data

Cloud data platforms

Education

Bachelor's degree in CS/Engineering

Tools

Spark

Hadoop

Kafka

AWS Redshift

Azure Data Lake

Google BigQuery

Job description

Our client is seeking a skilled Data Engineer to build and maintain robust data infrastructure in Durban. This role is crucial for enabling data‑driven insights across the organization by ensuring the availability, integrity and efficiency of our data systems. You will be responsible for designing, constructing, installing, testing and maintaining highly scalable data management systems. This position offers a significant opportunity to work with cutting‑edge big data technologies and contribute directly to the company's data strategy.

About the Role

Our client is seeking a skilled Data Engineer to build and maintain robust data infrastructure in Durban. This role is crucial for enabling data‑driven insights across the organization by ensuring the availability, integrity and efficiency of our data systems. You will be responsible for designing, constructing, installing, testing and maintaining highly scalable data management systems. This position offers a significant opportunity to work with cutting‑edge big data technologies and contribute directly to the company's data strategy.

Key Responsibilities

• Design, build, and maintain scalable and reliable ETL/ELT pipelines for batch and real‑time data processing.
• Develop and optimize data models and database schemas for performance and analytical use cases.
• Implement data warehousing solutions and manage large datasets using distributed computing frameworks.
• Ensure data quality, integrity, and security across all data platforms.
• Collaborate with data scientists and analysts to understand their data requirements and provide accessible data solutions.
• Monitor data systems, troubleshoot issues, and implement performance improvements.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 3+ years of experience as a Data Engineer or in a similar data‑focused role.
• Proficiency in SQL and experience with relational and NoSQL databases.
• Hands‑on experience with big data technologies such as Apache Spark, Hadoop, Kafka, or similar.
• Experience with cloud data platforms (e.g., AWS Redshift, Azure Data Lake, Google BigQuery).
• Strong programming skills in Python or Scala.

Benefits

• Competitive annual salary and potential for performance bonuses.
• Comprehensive health insurance coverage.
• Opportunities for learning and development in new data technologies.
• A collaborative work environment with a focus on innovation.
• Hybrid work arrangement promoting work‑life balance.

Johannesburg HB South Africa

Cape Town

Durban HB South Africa

Full time

R

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.