Senior Data Engineer

Placements24; Soweto; Hybrid; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Professional development

Paid time off

Collaborative environment

Job summary

Placements24 is recruiting a Senior Data Engineer for our client in Soweto to design, build, and maintain scalable data pipelines and data infrastructure that power BI and analytics initiatives.

You will work with large datasets, ensure data quality, and collaborate with data scientists and analysts to meet data requirements. Strong experience with data warehousing, ETL/ELT, and cloud services is essential for success.

Qualifications

• Bachelor's degree in CS/Engineering or related field.
• 5+ years in data engineering with data infrastructure focus.
• Strong SQL and database tech experience (PostgreSQL, SQL Server, Snowflake).
• Experience with Spark, Hadoop or similar distributed systems.
• Experience with ETL tools and cloud data services (AWS Glue, Azure Data Factory, Google Dataflow).
• Proficient in Python or Scala.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.
• Build and optimize data warehouses and data lakes.
• Ensure data quality and consistency across systems.
• Collaborate with data scientists and analysts on data needs.
• Implement data governance for security and compliance.
• Monitor pipelines and troubleshoot issues.

Skills

Data engineering

SQL

Big data technologies

Python/Scala

ETL/ELT design

Education

Bachelor's degree in Computer Science / Engineering

Tools

PostgreSQL

SQL Server

Snowflake

Spark

Hadoop

ETL tools

Job description

About the Role

Our client is looking for a skilled Senior Data Engineer to join their analytics team in Soweto. This role is responsible for designing, building, and maintaining scalable data pipelines and infrastructure that support business intelligence and data analytics initiatives. You will work with large datasets, ensuring data quality, availability, and accessibility for data scientists and analysts. The ideal candidate has a strong background in data warehousing, ETL processes, and big data technologies, and is passionate about creating robust data solutions. This position offers a fantastic opportunity to contribute to data-driven decision-making within a growing organization.

Key Responsibilities

• Design, develop, and maintain scalable and reliable data pipelines for ETL/ELT processes.
• Build and optimize data warehouses, data lakes, and other data storage solutions.
• Ensure data quality, integrity, and accuracy across all data systems.
• Collaborate with data scientists and analysts to understand data requirements and provide necessary data structures.
• Implement data governance policies and procedures to ensure data security and compliance.
• Monitor data pipeline performance and troubleshoot any issues that arise.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience in data engineering, with a strong focus on building and managing data infrastructure.
• Proficiency in SQL and experience with database technologies (e.g., PostgreSQL, SQL Server, Snowflake).
• Experience with big data technologies such as Spark , Hadoop, or similar distributed systems.
• Familiarity with ETL tools and cloud data services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow).
• Strong programming skills in Python or Scala.

Benefits

• Competitive salary and performance-based bonuses.
• Comprehensive medical, dental, and vision insurance.
• Opportunities for professional growth and development.
• Paid time off and company holidays.
• A collaborative work environment with a focus on innovation and data excellence.