Senior Data Engineer - Big Data Platforms

Placements24; Stellenbosch; Híbrido; ZAR 900.000 - 1.300.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Performance bonuses

Health insurance

Retirement plan

Hybrid work model

Training & certifications

Conferences

Descripción de la vacante

Placements24 seeks a Senior Data Engineer for our Stellenbosch client, a leader in AI & Emerging Technologies, to design, build, and maintain scalable data pipelines powering advanced analytics and AI initiatives. The role combines in-office collaboration with remote flexibility in a hybrid setup, enabling you to shape data architecture and enable data-driven insights.

You will work with Python/Java/Scala, Spark/Hadoop, and cloud services to deliver robust data solutions and mentor junior

Formación

• 5+ years of data engineering experience with big data systems.
• Proficiency in Python, Java, or Scala.
• Experience with Spark and Hadoop.
• Hands-on with cloud data platforms (AWS/Azure/GCP) and services (S3, Redshift, BigQuery, Data Factory).
• Expertise in SQL and diverse database technologies (relational and NoSQL).
• Knowledge of data warehousing concepts and dimensional modeling.
• Familiarity with data governance, quality, and security practices.

Responsabilidades

• Design, construct, install, test, and maintain scalable data management systems and pipelines.
• Develop and optimize ETL/ELT processes for large datasets.
• Build and maintain data lakes, data warehouses, and storage solutions.
• Collaborate with data scientists, analysts, and developers to meet data needs.
• Ensure data quality, integrity, and security across platforms.
• Implement monitoring and alerting for pipelines and infrastructure.
• Evaluate and propose new data technologies and tools.
• Mentor junior data engineers and promote best practices.

Conocimientos

Python

Java

Scala

Spark

Hadoop

SQL

NoSQL

Educación

Bachelor's or Master's in CS/Engineering

Herramientas

AWS

Azure

GCP

S3

Redshift

BigQuery

Data Factory

Data Lakes/Warehouses

Descripción del empleo

Our client, a leader in AI & Emerging Technologies, is seeking a highly skilled Senior Data Engineer to join their innovative team in Stellenbosch, Western Cape. This role is central to designing, building, and maintaining robust, scalable data pipelines and infrastructure that power our advanced analytics and AI initiatives. You will work with cutting-edge big data technologies to ensure the seamless flow and availability of data. This hybrid position offers a blend of in-office collaboration and remote flexibility, allowing you to leverage your expertise effectively in a dynamic work environment. You will play a key role in shaping our data architecture and enabling data-driven insights.

Key Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and pipelines.
• Develop and optimize ETL/ELT processes for large volumes of structured and unstructured data.
• Build and maintain data lakes, data warehouses, and other data storage solutions.
• Collaborate with data scientists, analysts, and application developers to understand their data needs and provide solutions.
• Ensure data quality, integrity, and security across all data platforms.
• Implement monitoring and alerting systems for data pipelines and infrastructure.
• Evaluate and recommend new technologies and tools to enhance data capabilities.
• Mentor junior data engineers and contribute to establishing best practices.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience in data engineering, with a proven track record in building and managing big data systems.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Extensive experience with distributed data processing frameworks (e.g., Spark, Hadoop).
• Hands‑on experience with cloud data platforms (AWS, Azure, GCP) and their associated services (e.g., S3, Redshift, BigQuery, Data Factory).
• Expertise in SQL and experience with various database technologies (relational and NoSQL).
• Familiarity with data warehousing concepts and dimensional modeling.
• Knowledge of data governance, data quality, and data security best practices.
• Excellent problem-solving skills and attention to detail.

Benefits

Our client offers a competitive salary, performance bonuses, and comprehensive benefits including health, retirement, and generous paid time off. We are committed to employee growth, providing opportunities for advanced training, certifications, and attending industry conferences. The hybrid work model in Stellenbosch, Western Cape allows for a balanced approach to work and personal life. You will be part of a forward-thinking organization where your contributions directly impact the development of innovative AI solutions and data-driven strategies.