Data Engineer

Placements24; Riverton (UT); Hybrid; USD 29,000 - 44,000; Full time

Benefits offered by this job

Performance bonus

Medical aid benefits

Professional development

Job summary

Placements24 is seeking a skilled Data Engineer to join our growing team in Upington, Northern Cape, with a hybrid work setup combining remote flexibility and on-site collaboration. The role focuses on building scalable ETL/ELT pipelines, data warehouses, and data lakes to support analytics initiatives.

You will ensure data quality and governance, collaborate with data scientists, and implement robust data processing architectures using SQL, Python/Scala, and cloud platforms (AWS/Azure/GCP).

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 3+ years of experience in data engineering or a similar role.
• Proficiency in SQL and experience with relational databases (PostgreSQL, MySQL).
• Experience with big data technologies (Spark, Hadoop) is a plus.
• Familiarity with cloud data platforms (AWS, Azure, GCP).
• Knowledge of ETL/ELT tools and processes.
• Proficiency in at least one programming language like Python or Scala.
• Understanding of data modeling techniques.
• Strong analytical and problem-solving skills.
• Good communication and teamwork abilities.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines.
• Develop and manage data warehouses and data lakes.
• Ensure data quality, integrity, and reliability.
• Optimize data retrieval and processing performance.
• Collaborate with data scientists and analysts to understand data needs.
• Implement data governance and security best practices.
• Automate data processes and monitoring.
• Work with various data sources, including databases, APIs, and flat files.
• Evaluate and recommend new data technologies and tools.
• Troubleshoot data-related issues and resolve them efficiently.

Skills

SQL

Python

Scala

Data modeling

Data analysis

Communication

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

PostgreSQL

MySQL

Spark

Hadoop

AWS

Azure

GCP

ETL tools

Job description

About the Role

Our client, a fast-paced data analytics firm, is seeking a skilled Data Engineer to join their growing team in Upington, Northern Cape. This role is essential for building and maintaining scalable data pipelines and infrastructure that support our data science and analytics initiatives. You will be responsible for data extraction, transformation, loading (ETL), data warehousing, and ensuring the availability and quality of data across the organization. This is a hybrid role, offering a blend of remote work flexibility and on-site collaboration at our Upington office. The ideal candidate possesses strong technical skills in data processing and a passion for building robust data solutions.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines.
• Develop and manage data warehouses and data lakes.
• Ensure data quality, integrity, and reliability.
• Optimize data retrieval and processing performance.
• Collaborate with data scientists and analysts to understand data needs.
• Implement data governance and security best practices.
• Automate data processes and monitoring.
• Work with various data sources, including databases, APIs, and flat files.
• Evaluate and recommend new data technologies and tools.
• Troubleshoot data-related issues and resolve them efficiently.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 3+ years of experience in data engineering or a similar role.
• Proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
• Experience with big data technologies (e.g., Spark, Hadoop) is a plus.
• Familiarity with cloud data platforms (AWS, Azure, GCP).
• Knowledge of ETL/ELT tools and processes.
• Proficiency in at least one programming language like Python or Scala.
• Understanding of data modeling techniques.
• Strong analytical and problem-solving skills.
• Good communication and teamwork abilities.

Benefits

• Competitive salary and performance bonuses.
• Comprehensive medical aid benefits.
• Opportunities for professional development and training.
• Hybrid work arrangement offering flexibility.
• Exposure to diverse data challenges in the Upington, Northern Cape region.
• A collaborative and supportive work environment.
• Generous annual leave.