Data Engineer-Dutch OR French

MEERAB GROUP; Brussel Hoofdstad; Sur place; EUR 60 000 - 90 000; Plein temps

Résumé du poste

MEERAB GROUP is seeking a Data Engineer to define, design and implement consolidation and reference data management across SPW systems. You will build data feeds and ensure traceability, quality controls, and compliance with architectural standards.

You will work with Python and SQL, leverage AWS data projects, and orchestrate pipelines with Apache Airflow. French and English proficiency is required to collaborate across teams.

Qualifications

• Proven experience as a Data Engineer.
• Strong expertise in Python and SQL.
• Hands-on experience with AWS in data-related projects.
• Solid practice of Apache Airflow for pipeline orchestration.
• Experience with Dataiku is a strong plus.
• Comfortable working in complex and structured data environments.
• Professional proficiency in French and English (written and spoken).

Responsabilités

• Definition and implementation of consolidation and reference data management.
• Definition and implementation of data integration processes.
• Maintain data feed chains on the basis of the FME platform.
• Define rules for data transformation, normalization and consolidation.
• Implement connectors and integration flows for feeding and distributing repository data.
• Ensure full traceability of data exchanges and compliance with SPW architecture standards.
• Definition of quality controls and validation rules.
• Collaborate with the Data Virtualization Service Center and the DGVD to ensure consistency of the consolidated view of companies available to applications.

Connaissances

Python

SQL

AWS

Apache Airflow

French & English

Outils

FME platform

Dataiku

Description du poste

• Definition and implementation of consolidation and reference data management

The Data Engineer brings their expertise to define, design and implement

• The mechanisms ensuring the generation and management of the SPW's unique identifier;
• The mechanisms for deduplication of businesses;
• Rules for consolidation and prioritization between sources
• Data conflict management mechanisms.

It collaborates with the Data Virtualization Service Center and the DGVD to ensure the consistency of the consolidated view of companies made available to applications.

• Definition and implementation of data integration processes

The Data Engineer brings their expertise to

• Design and maintain, on the basis of the FME platform, the data feed chains of the repository from data sources and contributing applications, in close collaboration with the DGVD and the CS VD and ensuring compliance with standards for data sharing and exchange.
• Define, based on the FME platform, the rules for data transformation, normalization and consolidation.
• Implement the necessary connectors and integration flows for feeding and distributing repository data.
• Ensure full traceability of data exchanges and compliance with SPW architecture standards.
• Definition of quality controls and validation rules

In conjunction with the Data Management and Enhancement Department team, he defines the quality controls applicable to data during its integration into the repository. To do this, he relies on FME tools as well as the DataLift developed within the Data Management and Enhancement Department.

Proven experience as a Data Engineer

Strong expertise in Python and SQL

Hands-on experience with AWS in data-related projects

Solid practice of Apache Airflow for pipeline orchestration

Experience with Dataiku is a strong plus

Comfortable working in complex and structured data environments

Professional proficiency in French and English (written and spoken)