Hybrid Data Engineer: Build Scalable Pipelines & Lakes

Placements24; Upington; Hybrid; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Competitive bonus

Medical aid

Hybrid work

Annual leave

Job summary

Placements24 in Upington, Northern Cape seeks a Data Engineer to design and maintain scalable ETL pipelines, data warehouses, and data lakes. You will ensure data quality and collaborate with data scientists to enable robust analytics.

The role offers a hybrid work arrangement with on-site collaboration in Upington and remote work options. A strong focus on data governance, security, and performance is required, along with proficiency in SQL, Python/Scala, and cloud platforms.

Qualifications

• Bachelor’s degree in Computer Science, Engineering or related field.
• 3+ years in data engineering or similar role.
• Proficiency in SQL and relational databases (PostgreSQL, MySQL).
• Experience with big data tech (Spark, Hadoop) is a plus.
• Familiarity with cloud data platforms (AWS, Azure, GCP).
• Knowledge of ETL/ELT tools and processes.
• Proficiency in Python or Scala.
• Understanding of data modeling techniques.
• Strong analytical and problem-solving skills.
• Good communication and teamwork abilities.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines.
• Develop and manage data warehouses and data lakes.
• Ensure data quality, integrity, and reliability.
• Optimize data retrieval and processing performance.
• Collaborate with data scientists and analysts to understand data needs.
• Implement data governance and security best practices.
• Automate data processes and monitoring.
• Work with databases, APIs, and flat files.
• Evaluate and recommend new data technologies and tools.
• Troubleshoot data-related issues and resolve them efficiently.

Education

Bachelor's degree in CS/Engineering

Tools

SQL

PostgreSQL

MySQL

Spark

Hadoop

AWS

Azure

GCP

ETL/ELT

Python

Scala

Data Modeling

Job description

Placements24 in Upington, Northern Cape seeks a Data Engineer to design and maintain scalable ETL pipelines, data warehouses, and data lakes. You will ensure data quality and collaborate with data scientists to enable robust analytics.

The role offers a hybrid work arrangement with on-site collaboration in Upington and remote work options. A strong focus on data governance, security, and performance is required, along with proficiency in SQL, Python/Scala, and cloud platforms.