Senior Data Engineer

Our client is a highly successful NPO. The work you will be involved with is highly impactful and am sure will bring joy as well as provide a highly stimulating and fabulous work experience.

What you will be doing :

1. Collaborate with stakeholders to design, implement, and maintain data solutions, aligning with strategic vision.
2. Build and maintain scalable infrastructure for real-time and batch data processing.
3. Select and integrate big data tools, ensuring efficient data storage, transformation, and analysis.
4. Provide guidance and support on data usage, security, and architecture.
5. Monitor performance, optimize data ingestion, and recommend infrastructure adjustments.
6. Partner with data analysts and business intelligence to ensure data quality and accuracy.

What our client is looking for :

1. A relevant Bachelor's degree would be ideal.
2. 8+ years of experience as a Data Engineer designing, building, and maintaining data pipelines.
3. Proficiency in SQL and with a variety of database systems (e.g., MySQL).
4. Strong knowledge of ETL / data processing frameworks and technologies, such as Apache Beam, Apache Spark, and SSIS, for both batch and real-time processing.
5. Expertise in data modelling techniques and methodologies.
6. Experience with cloud platforms such as Google Cloud Platform (GCP), Azure, or AWS.
7. Proficiency in Python and other relevant programming languages.
8. Familiarity with statistical analysis / data visualisation tools and techniques, such as R or Python libraries.
9. Analytical / problem-solving skills, with the ability to identify and resolve data-related issues.
10. Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams, including data scientists, software engineers, and business stakeholders.

Job ID : J106866