Data Engineer

Placements24; Soweto; Hybrid; ZAR 500,000 - 900,000; Full time

Job summary

Placements24 is seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and infrastructure in Soweto. You will support analytics, ML, and BI initiatives by developing data systems, warehouses, and data lakes with strong data quality and governance.

The role requires expertise in SQL, Python/Scala, and experience with Spark/Hadoop and cloud data services, collaborating with data scientists and stakeholders to deliver reliable data solutions.

Qualifications

• Bachelor's degree in CS, Engineering, or related field.
• 3+ years of data engineering experience.
• Experience with SQL databases and data warehousing.
• Experience with Spark/Hadoop and cloud data services.

Responsibilities

• Design, build, and maintain scalable data pipelines using ETL/ELT processes.
• Develop and manage data warehouses and data lakes.
• Ensure data quality and reliability across systems.
• Collaborate with data scientists, analysts, and stakeholders.
• Optimize data processing and queries for performance.
• Implement data governance and security best practices.

Skills

SQL

Python

Scala

Education

Bachelor's degree in Computer Science/Engineering

Tools

PostgreSQL

MySQL

Snowflake

BigQuery

Spark

Hadoop

Job description

About the Role

Our client is seeking a skilled and proactive Data Engineer to build and maintain robust data pipelines and infrastructure in Soweto . You will be responsible for designing, developing, and optimizing data systems that support analytics, machine learning, and business intelligence initiatives. This role requires a strong understanding of data warehousing concepts, ETL processes, and big data technologies. Join a growing data team that is instrumental in driving informed business decisions through reliable and accessible data.

Key Responsibilities

• Design, build, and maintain scalable and efficient data pipelines using ETL/ELT processes.
• Develop and manage data warehouses, data lakes, and other data storage solutions.
• Ensure data quality, integrity, and reliability across all data systems.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions.
• Optimize data processing performance and database queries for speed and efficiency.
• Implement data governance and security best practices.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 3+ years of experience in data engineering or a related role.
• Proficiency in SQL and experience with database systems (e.g., PostgreSQL, MySQL, Snowflake, BigQuery).
• Experience with big data technologies (e.g., Spark, Hadoop) and data warehousing concepts.
• Knowledge of programming languages commonly used in data engineering, such as Python or Scala.
• Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.

Benefits

• Competitive salary and performance bonuses.
• Comprehensive medical aid and retirement fund benefits.
• Opportunities for professional development and training in data technologies.
• A collaborative environment focused on data innovation.
• Work on challenging projects that impact business strategy.