Senior Data Engineer (JHB) at Parvana Recruitment

Parvana Strategic Sourcing; Cape Town; On-site; ZAR 400,000 - 800,000; Full time

Job summary

An impactful non-profit organization is seeking a skilled Data Engineer to enhance their data solutions. In this role, you will collaborate with stakeholders to design and implement robust data infrastructures, ensuring the seamless integration of big data tools for efficient storage and analysis. Your expertise in SQL, cloud platforms, and data processing frameworks will be crucial in optimizing data workflows and maintaining data quality. This position offers a stimulating work environment where your contributions will directly impact the organization's mission and goals. If you are passionate about data and want to make a difference, this opportunity is for you.

Qualifications

• 8+ years experience as a Data Engineer with strong SQL and database skills.
• Expertise in ETL frameworks and cloud platforms like GCP, Azure, or AWS.

Responsibilities

• Collaborate with stakeholders to design and maintain data solutions.
• Build scalable infrastructure for real-time and batch data processing.

Skills

Data Engineering

SQL

Analytical Skills

Problem-Solving

Communication Skills

Education

Bachelor's Degree

Tools

MySQL

Apache Beam

Apache Spark

SSIS

Google Cloud Platform

Azure

AWS

Python

R

Job description

About the client:
Our client is a highly successful NPO. The work you will be involved with is highly impactful and will provide a stimulating and fabulous work experience.

What you will be doing:

• Collaborate with stakeholders to design, implement, and maintain data solutions, aligning with strategic vision.
• Build and maintain scalable infrastructure for real-time and batch data processing.
• Select and integrate big data tools, ensuring efficient data storage, transformation, and analysis.
• Provide guidance and support on data usage, security, and architecture.
• Monitor performance, optimize data ingestion, and recommend infrastructure adjustments.
• Partner with data analysts and business intelligence to ensure data quality and accuracy.

What our client is looking for:

• A relevant Bachelor's degree would be ideal.
• 8+ years of experience as a Data Engineer designing, building, and maintaining data pipelines.
• Proficiency in SQL and with a variety of database systems (e.g., MySQL).
• Strong knowledge of ETL / data processing frameworks and technologies, such as Apache Beam, Apache Spark, and SSIS, for both batch and real-time processing.
• Expertise in data modelling techniques and methodologies.
• Experience with cloud platforms such as Google Cloud Platform (GCP), Azure, or AWS.
• Proficiency in Python and other relevant programming languages.
• Familiarity with statistical analysis / data visualisation tools and techniques, such as R or Python libraries.
• Analytical / problem-solving skills, with the ability to identify and resolve data-related issues.
• Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams, including data scientists, software engineers, and business stakeholders.

Job ID: J106866

Desired Skills:

• Data Engineer
• SQL
• MySQL