Senior Data Engineer

Placements24; Mtubatuba Local Municipality; Hybrid; ZAR 900,000 - 1,200,000; Full time

Benefits offered by this job

Hybrid work model

Professional development

Job summary

Placements24 in Richards Bay seeks a Senior Data Engineer to design and maintain scalable data pipelines, data warehouses and lakes, enabling analytics and BI. Hybrid work model offers team collaboration and flexibility.

The role emphasizes data quality, security, and collaboration with data scientists and stakeholders, with big data tech and cloud services experience preferred.

Qualifications

• Bachelor's degree in CS/Engineering or related field.
• 5+ years' data engineering with warehousing concepts.
• Proficiency in SQL; Python or Scala.
• Experience with Spark/Hadoop and cloud data services.
• Familiar with ETL/ELT and Airflow.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Develop and manage data warehouses and data lakes.
• Implement data modeling for BI and analytics.
• Ensure data quality, integrity, and security.
• Collaborate with data scientists, analysts, and stakeholders.
• Monitor data systems and troubleshoot to maintain performance.

Skills

SQL

Python

Scala

Spark

Hadoop

Airflow

Data Modeling

Data Warehousing

Data Quality

Education

Bachelor's degree in Computer Science/Engineering

Tools

AWS Redshift

Azure Synapse

GCP BigQuery

Job description

About the Role

Our client is seeking a talented Senior Data Engineer to join their analytics team in Richards Bay . You will be instrumental in building and maintaining robust data pipelines, ensuring the availability and integrity of data for analytics and business intelligence purposes. This role involves working with large datasets, designing data models, and optimizing data storage and retrieval processes to support data-driven decision-making. Join a collaborative team that values innovation and leverages data to drive strategic initiatives, benefiting from a hybrid work arrangement that fosters both team cohesion and personal flexibility.

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines using ETL/ELT processes.
• Develop and manage data warehouses and data lakes, optimizing for performance and cost-efficiency.
• Implement data modeling techniques to support business intelligence and analytical requirements.
• Ensure data quality, integrity, and security throughout the data lifecycle.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver actionable insights.
• Monitor data systems, troubleshoot issues, and implement solutions to ensure optimal performance and availability.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience in data engineering , with a strong understanding of data warehousing concepts and technologies.
• Proficiency in SQL and experience with programming languages such as Python or Scala.
• Hands-on experience with big data technologies (e.g., Spark, Hadoop) and cloud data services (AWS Redshift, Azure Synapse, GCP BigQuery).
• Familiarity with ETL tools and data orchestration frameworks (e.g., Apache Airflow).
• Strong analytical and problem-solving skills, with a keen eye for detail and data accuracy.

Benefits

• Competitive salary and performance-related bonuses.
• Comprehensive medical coverage and retirement planning options.
• Opportunities for continuous learning and professional development in data technologies.
• A hybrid work model providing flexibility and a balance between office collaboration and remote work.
• A dynamic work environment focused on leveraging data to achieve business objectives.