Data Engineer

Placements24; Upington; Hybrid; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Competitive bonus

Medical aid

Hybrid work

Annual leave

Job summary

Placements24 in Upington, Northern Cape seeks a Data Engineer to design and maintain scalable ETL pipelines, data warehouses, and data lakes. You will ensure data quality and collaborate with data scientists to enable robust analytics.

The role offers a hybrid work arrangement with on-site collaboration in Upington and remote work options. A strong focus on data governance, security, and performance is required, along with proficiency in SQL, Python/Scala, and cloud platforms.

Qualifications

• Bachelor’s degree in Computer Science, Engineering or related field.
• 3+ years in data engineering or similar role.
• Proficiency in SQL and relational databases (PostgreSQL, MySQL).
• Experience with big data tech (Spark, Hadoop) is a plus.
• Familiarity with cloud data platforms (AWS, Azure, GCP).
• Knowledge of ETL/ELT tools and processes.
• Proficiency in Python or Scala.
• Understanding of data modeling techniques.
• Strong analytical and problem-solving skills.
• Good communication and teamwork abilities.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines.
• Develop and manage data warehouses and data lakes.
• Ensure data quality, integrity, and reliability.
• Optimize data retrieval and processing performance.
• Collaborate with data scientists and analysts to understand data needs.
• Implement data governance and security best practices.
• Automate data processes and monitoring.
• Work with databases, APIs, and flat files.
• Evaluate and recommend new data technologies and tools.
• Troubleshoot data-related issues and resolve them efficiently.

Education

Bachelor's degree in CS/Engineering

Tools

SQL

PostgreSQL

MySQL

Spark

Hadoop

AWS

Azure

GCP

ETL/ELT

Python

Scala

Data Modeling

Job description

About the Role

Our client, a fast-paced data analytics firm, is seeking a skilled Data Engineer to join their growing team in Upington, Northern Cape . This role is essential for building and maintaining scalable data pipelines and infrastructure that support our data science and analytics initiatives. You will be responsible for data extraction, transformation, loading (ETL), data warehousing, and ensuring the availability and quality of data across the organization. This is a hybrid role, offering a blend of remote work flexibility and on-site collaboration at our Upington office. The ideal candidate possesses strong technical skills in data processing and a passion for building robust data solutions.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines.
• Develop and manage data warehouses and data lakes.
• Ensure data quality, integrity, and reliability.
• Optimize data retrieval and processing performance.
• Collaborate with data scientists and analysts to understand data needs.
• Implement data governance and security best practices.
• Automate data processes and monitoring.
• Work with various data sources, including databases, APIs, and flat files.
• Evaluate and recommend new data technologies and tools.
• Troubleshoot data-related issues and resolve them efficiently.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 3+ years of experience in data engineering or a similar role.
• Proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
• Experience with big data technologies (e.g., Spark, Hadoop) is a plus.
• Familiarity with cloud data platforms (AWS, Azure, GCP).
• Knowledge of ETL/ELT tools and processes.
• Proficiency in at least one programming language like Python or Scala.
• Understanding of data modeling techniques.
• Strong analytical and problem-solving skills.
• Good communication and teamwork abilities.

Benefits

• Competitive salary and performance bonuses.
• Comprehensive medical aid benefits.
• Opportunities for professional development and training.
• Hybrid work arrangement offering flexibility.
• Exposure to diverse data challenges in the Upington, Northern Cape region.
• A collaborative and supportive work environment.
• Generous annual leave.