Senior Data Engineer

Placements24; Paarl; Hybrid; ZAR 900.000 - 1.200.000; Vollzeit

Benefits dieser Stelle

Competitive salary and benefits

Health and wellness benefits

Retirement savings plan

Professional development opportunities

Flexible working arrangements

Performance bonuses

Generous paid time off

Zusammenfassung

Placements24 in Paarl, Western Cape, is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure for analytics and ML initiatives.

You will work with Spark, Hadoop, and cloud services across AWS/Azure/GCP, ensure data quality, and collaborate with data scientists and analysts to enable data-driven decisions.

This role offers opportunities for professional growth, a collaborative team, and a flexible work arrangement.

Qualifikationen

• Bachelor's degree in Computer Science, Engineering, or related quantitative field or equivalent practical experience.
• 5+ years of professional experience in data engineering or related role.
• Proficiency in Python, Scala, or Java.
• Strong SQL and experience with relational and NoSQL databases.
• Hands-on experience with big data technologies (Apache Spark, Hadoop).
• Experience with cloud data platforms (AWS S3, Redshift, EMR; Azure Data Lake, Databricks; GCP BigQuery, Dataflow).
• Familiarity with data warehousing concepts and tools.
• Experience with Airflow is a plus.
• Excellent problem-solving, analytical, and communication skills.

Aufgaben

• Design, build, and maintain robust, scalable data pipelines using ETL/ELT tools and technologies.
• Develop and optimize data warehousing solutions and data lakes.
• Implement data quality frameworks ensuring accuracy and completeness.
• Collaborate with data scientists and analysts to understand data needs.
• Work with Spark, Hadoop, and cloud-based data services (AWS, Azure, GCP).
• Automate data processes and monitor pipeline performance for efficiency.
• Ensure data security and compliance with regulations.
• Optimize database performance and manage database systems.
• Stay updated with trends in data engineering.
• Document data processes, architecture, and metadata.

Kenntnisse

Python

Scala

Java

SQL

Airflow

Ausbildung

Bachelor's degree in Computer Science or related field

Tools

Apache Spark

Hadoop

AWS

Azure

GCP

Jobbeschreibung

About the Role

Our client, a leading analytics and insights firm, is seeking a Senior Data Engineer to join their expanding data platform team. This critical role is based in the picturesque and technologically active city of Paarl, Western Cape . The successful candidate will be responsible for designing, building, and maintaining scalable and efficient data pipelines and infrastructure that support the company's advanced analytics and machine learning initiatives. You will work with large, complex datasets, employing cutting-edge technologies to ensure data quality, availability, and accessibility for data scientists and analysts. We are looking for an experienced professional with a passion for data architecture, a strong command of ETL processes, and a commitment to enabling data-driven decision-making across the organization.

Key Responsibilities

• Design, build, and maintain robust, scalable, and reliable data pipelines using various ETL/ELT tools and technologies.
• Develop and optimize data warehousing solutions and data lakes.
• Implement data quality frameworks and ensure data accuracy, consistency, and completeness.
• Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and provide solutions.
• Work with big data technologies such as Spark, Hadoop, and cloud-based data services (AWS, Azure, GCP).
• Automate data processes and monitor pipeline performance for efficiency and reliability.
• Ensure data security and compliance with relevant regulations.
• Optimize database performance and manage database systems.
• Stay updated with the latest trends and technologies in data engineering.
• Document data processes, architecture, and metadata.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent practical experience.
• 5+ years of professional experience in data engineering or a related role.
• Proven experience designing and implementing complex data pipelines and ETL processes.
• Proficiency in programming languages such as Python, Scala, or Java.
• Strong experience with SQL and working with relational and NoSQL databases.
• Hands‑on experience with big data technologies (e.g., Apache Spark, Hadoop ecosystem).
• Experience with cloud data platforms (AWS S3, Redshift, EMR; Azure Data Lake, Databricks; GCP BigQuery, Dataflow).
• Familiarity with data warehousing concepts and tools.
• Experience with workflow management tools like Airflow is a plus.
• Excellent problem‑solving, analytical, and communication skills.

Benefits

• Our client offers a competitive salary, comprehensive health and wellness benefits, and a retirement savings plan.
• Opportunities for professional development, including training, certifications, and conference attendance, are readily available.
• You will join a collaborative and innovative team in the beautiful region of Paarl, Western Cape , working on impactful data projects.
• The company culture promotes work-life balance, offering flexible working arrangements.
• Performance bonuses and generous paid time off are also part of the attractive package, ensuring a rewarding career experience.