Senior Data Engineer - Cloud Platforms

Placements24; Centurion; Hybrid; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Competitive salary

Health coverage

Generous leave

Retirement plan

Professional development

Cloud resources access

Collaborative culture

Career growth

Hybrid work

Impactful projects

Job summary

Placements24 is seeking a Senior Data Engineer for a technology services role in Centurion, Gauteng. You will design, build and maintain scalable data pipelines, warehouses and lakes on AWS/Azure/GCP to support analytics and BI initiatives.

You will collaborate with data scientists and analysts, implement ETL/ELT processes, ensure data quality and security, and mentor junior engineers in a hybrid Centurion-based setup.

Qualifications

• Bachelor's degree in CS/Engineering/IT or related quantitative field.

Responsibilities

• Design, develop, and optimize robust, scalable data pipelines for ingestion, transformation, and aggregation.
• Build and maintain data warehouses and data lakes on cloud platforms (AWS/Azure/GCP).
• Implement ETL/ELT processes using various tools and technologies.
• Ensure data quality, integrity, and consistency across data systems.
• Collaborate with data scientists and analysts to meet data needs and provide efficient access.
• Develop and manage data models supporting reporting and analytics.
• Monitor data infrastructure performance and drive improvements.
• Adhere to data security best practices and governance policies.
• Automate data processes and workflows to increase efficiency.
• Stay updated with trends in data engineering and cloud computing.
• Troubleshoot and resolve data issues promptly.
• Mentor junior data engineers and share knowledge.

Skills

SQL

NoSQL

Python

Scala

Java

Big data

ETL/ELT

Airflow

Spark

Hadoop

Kafka

Education

Bachelor's degree in Computer Science, Engineering, Information Technology, or related field

Tools

AWS Redshift

AWS S3

AWS Glue

Azure Data Factory

Azure Synapse

Google BigQuery

Google Cloud Storage

Airflow

Job description

About the Role

Our client, a leading technology services provider, is seeking a Senior Data Engineer to join their innovative team in Centurion, Gauteng . This role is crucial for designing, building, and maintaining scalable data infrastructure and pipelines that support the company's advanced analytics and business intelligence initiatives. You will work with large, complex datasets, leveraging cloud platforms to ensure data is accessible, reliable, and optimized for performance. The ideal candidate will possess a deep understanding of data warehousing, ETL processes, big data technologies, and cloud data services. You will collaborate closely with data scientists, analysts, and business stakeholders to understand data needs and deliver robust data solutions. This position offers a fantastic opportunity to shape the data landscape of a forward-thinking organization and contribute to data-driven decision-making across various departments. The role offers a blend of challenging technical work and impactful business contributions in a dynamic environment in Centurion, Gauteng .

Key Responsibilities

• Design, develop, and optimize robust, scalable data pipelines for data ingestion, transformation, and aggregation.
• Build and maintain data warehouses and data lakes on cloud platforms such as AWS, Azure, or GCP.
• Implement ETL/ELT processes using various tools and technologies.
• Ensure data quality, integrity, and consistency across all data systems.
• Collaborate with data scientists and analysts to understand their data requirements and provide efficient data access.
• Develop and manage data models that support business reporting and analytics needs.
• Monitor data infrastructure performance and implement improvements for efficiency and reliability.
• Implement data security best practices and ensure compliance with data governance policies.
• Automate data processes and workflows for increased efficiency and reduced manual intervention.
• Stay current with emerging trends and technologies in data engineering and cloud computing.
• Troubleshoot and resolve data-related issues in a timely manner.
• Mentor junior data engineers and contribute to team knowledge sharing.

Requirements

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field.
• 5+ years of professional experience in data engineering, with a strong focus on building and managing data infrastructure.
• Proven experience with cloud data services (e.g., AWS Redshift/S3/Glue, Azure Data Factory/Synapse, Google BigQuery/Cloud Storage).
• Proficiency in SQL and experience with NoSQL databases.
• Strong programming skills in languages such as Python, Scala, or Java.
• Experience with big data technologies (e.g., Spark, Hadoop, Kafka) is essential.
• Knowledge of data warehousing concepts and best practices.
• Experience with ETL/ELT tools and workflow orchestration (e.g., Airflow).
• Excellent problem-solving, analytical, and troubleshooting skills.
• Strong communication and collaboration abilities.
• Ability to work effectively in a hybrid work model in Centurion, Gauteng .

Benefits

• Competitive salary package with performance-based incentives.
• Comprehensive medical, dental, and vision insurance.
• Generous annual leave and company holidays.
• Retirement savings plan with employer match.
• Opportunities for professional development, training, and certifications.
• Access to advanced cloud computing resources and tools.
• Collaborative and innovative work environment.
• Potential for career advancement within a growing organization.
• Hybrid work model offering flexibility.
• Engage in impactful projects driving data-driven strategy.