Senior Data Engineer

Placements24; Randburg; Hybrid; GBP 41,000 - 68,000; Full time

Benefits offered by this job

Hybrid work model

Health benefits

Professional development

Job summary

Placements24 is searching for a Senior Data Engineer to lead the design and maintenance of scalable data pipelines and data infrastructure in a hybrid work setup. You will collaborate with data scientists, analysts, and BI teams to deliver reliable data solutions for analytics and business intelligence initiatives.

The role requires 5+ years in data engineering, strong SQL, and expertise in cloud platforms and big data tools. A focus on data quality, governance, and performance is essential.

Qualifications

• 5+ years of data engineering experience.
• Strong SQL proficiency and data warehousing knowledge.
• Proficient in Python or Scala and big data tech (Spark/Hadoop).
• Experience with cloud data services (AWS/Azure/GCP).
• Familiar with orchestration tools like Airflow or Luigi.

Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines.
• Develop and manage data warehouses and data lakes.
• Optimize data retrieval and processing for performance and cost.
• Collaborate with data scientists and analysts on data needs.
• Implement data governance and security best practices.
• Monitor and troubleshoot data infrastructure and pipelines.

Skills

5+ years experience

SQL

Python/Scala

Cloud platforms

Airflow

Education

Bachelor's or Master's in CS/Engineering

Tools

PostgreSQL

MySQL

Snowflake

Redshift

Spark

Hadoop

Job description

About the Role

Our client, a data-driven analytics firm located in Randburg , is seeking a highly experienced Senior Data Engineer . This role is critical for building and maintaining robust, scalable data pipelines and infrastructure that support the company's analytics and business intelligence initiatives. You will work with large datasets, implement data warehousing solutions, and ensure data quality and accessibility for the data science and business teams. This is an exceptional opportunity to shape the data landscape of a growing organization.

Key Responsibilities

• Design, build, and maintain scalable and reliable ETL/ELT data pipelines.


• Develop and manage data warehouses, data lakes, and other data storage solutions.


• Optimize data retrieval and processing for performance and efficiency.


• Collaborate with data scientists and analysts to understand data requirements and provide data solutions.


• Implement data governance, quality, and security best practices.


• Monitor and troubleshoot data infrastructure and pipeline issues.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.


• 5+ years of experience in data engineering or a related role.


• Proficiency in SQL and experience with various database technologies (e.g., PostgreSQL, MySQL, Snowflake, Redshift).


• Strong programming skills in Python or Scala and experience with big data technologies (e.g., Spark, Hadoop).


• Experience with cloud platforms (AWS, Azure, GCP) and related data services.


• Familiarity with data pipeline orchestration tools (e.g., Airflow, Luigi).

Benefits

• Competitive salary and performance bonus structure.


• Comprehensive health and wellness benefits.


• Flexible hybrid work model allowing for remote and in-office work.


• Opportunities for professional development and skill enhancement.


• A collaborative work environment within Randburg , focused on data innovation.