Senior Data Engineer

Placements24; Paarl; Hybrid; ZAR 900,000 - 1,400,000; Full time

Benefits offered by this job

Competitive salary

Health insurance

Hybrid work model

Professional development

Job summary

Placements24 in Paarl is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that support our clients' data-driven initiatives. You will handle large data volumes, implement robust ETL/ELT processes, and optimize data warehousing solutions.

The ideal candidate has 5+ years in data engineering, strong SQL and programming skills (Python/Scala/Java), and hands-on experience with Spark, Hadoop, Kafka, and cloud platforms (AWS/Azure/GCP).

Qualifications

• Bachelor's degree in Computer Science, Engineering or related field.
• 5+ years of experience in data engineering and large-scale data infrastructure.
• Proficiency in SQL and databases (PostgreSQL, SQL Server, Snowflake).
• Strong programming skills in Python, Scala or Java.
• Experience with Spark, Hadoop and Kafka; cloud data services.

Responsibilities

• Design, develop, and optimize robust data pipelines (ETL/ELT).
• Build and maintain data warehouses, data lakes, and storage solutions.
• Ensure data quality, integrity and security across platforms.
• Collaborate with data scientists and stakeholders to deliver data solutions.
• Implement data modeling best practices and standards.
• Monitor systems performance and troubleshoot for reliability.

Skills

Python/Scala/Java

SQL

Big data

Data warehousing

Data modeling

Education

Bachelor's degree in CS/Engineering

Tools

PostgreSQL

SQL Server

Snowflake

Spark

Hadoop

Kafka

AWS

Azure

GCP

Job description

About the Role

Our client is seeking a highly skilled Senior Data Engineer to join their growing analytics team in Paarl . This role is pivotal in designing, building, and maintaining scalable data pipelines and infrastructure that support the organization's data-driven initiatives. You will work with large volumes of data, implementing robust ETL processes, ensuring data quality, and optimizing data warehousing solutions. The ideal candidate possesses a strong understanding of data architecture, excellent programming skills, and a passion for transforming raw data into actionable insights that drive business growth in the beautiful Western Cape region.

Key Responsibilities

• Design, develop, and optimize robust and scalable data pipelines (ETL/ELT) to ingest and process data from various sources.
• Build and maintain data warehouses, data lakes, and other data storage solutions.
• Ensure data quality, integrity, and security across all data platforms.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
• Implement data modeling best practices and standards.
• Monitor data systems performance, troubleshoot issues, and implement solutions to ensure reliability and efficiency.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent experience.
• 5+ years of experience in data engineering, with a focus on building and managing large-scale data infrastructure.
• Proficiency in SQL and experience with database technologies (e.g., PostgreSQL, SQL Server, Snowflake).
• Strong programming skills in Python or Scala/Java.
• Experience with big data technologies such as Spark, Hadoop, Kafka.
• Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.

Benefits

• Competitive salary and attractive bonus structure.
• Comprehensive health, dental, and vision insurance.
• Hybrid work model offering a flexible work environment.
• Opportunities for professional development, including training and certifications.
• Collaborative team environment focused on innovation and data excellence in Paarl .