Data Engineer: Scalable Pipelines & Warehousing

Placements24; Noord-Kaap; On-site; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Competitive salary

Health benefits

Retirement plan

Professional development

Job summary

Placements24 in Kimberley, South Africa, is seeking a Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that support analytics and business intelligence. You will work with large datasets, implement data warehousing solutions, and ensure data quality and accessibility for analysts.

The ideal candidate has 3+ years in data engineering, strong SQL and Python skills, and hands-on experience with Snowflake, Redshift, BigQuery, Spark, and Hadoop on cloud

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related quantitative field, or equivalent work experience.
• Minimum of 3 years of professional experience in data engineering or a related role.
• Proven experience in designing and building data pipelines using SQL and programming languages like Python.
• Hands-on experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery) and ETL tools.

Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and pipelines.
• Develop and optimize ETL processes to consolidate data from various sources into data warehouses or data lakes.
• Ensure data quality, consistency, and availability across all data systems.
• Collaborate with Data Scientists and Analysts to provide reliable data sets for analysis.
• Monitor data pipeline performance and troubleshoot issues to ensure timely data delivery.
• Implement data security and governance best practices within the data infrastructure.

Skills

SQL

Python

ETL

Data Warehousing

Data Modeling

Spark

Hadoop

Cloud Platforms

Education

Bachelor's degree in CS/IT

Tools

Snowflake

Redshift

BigQuery

ETL Tools

Job description

Placements24 in Kimberley, South Africa, is seeking a Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that support analytics and business intelligence. You will work with large datasets, implement data warehousing solutions, and ensure data quality and accessibility for analysts.

The ideal candidate has 3+ years in data engineering, strong SQL and Python skills, and hands-on experience with Snowflake, Redshift, BigQuery, Spark, and Hadoop on cloud