Senior Data Engineer - Secure On-Prem Data Platform

In4Matic; Brussel; Sur place; EUR 70 000 - 100 000; Plein temps

Résumé du poste

In4Matic is seeking an experienced Data Engineer to join the team and contribute to the development of a secure, on-premise data platform in a highly regulated environment. You will collaborate with architecture and BI specialists to build robust data solutions emphasizing security, governance, traceability and data sovereignty.

The role focuses on designing ingestion pipelines, implementing SCD patterns, Delta Lake and end-to-end data lineage, and exposing curated data to BI dashboards in a

Qualifications

• Strong Python and SQL expertise.
• Experience with dbt-core and data modelling.
• Familiarity with data governance and metadata platforms.

Responsabilités

• Design and deploy data ingestion pipelines from heterogeneous sources.
• Implement incremental and streaming ingestion with end-to-end traceability.
• Develop transformation models following a Medallion Architecture (Bronze, Silver, Gold).
• Implement data historization patterns (SCD Type 2, upserts, append-only).
• Develop and maintain Delta Lake tables and exports with ACID, time travel, and optimization.
• Build and maintain orchestration assets; monitor runs; automate alerts.
• Manage metadata; support data lineage and governance documentation.
• Expose Gold-layer data to BI dashboards in collaboration with reporting teams.

Connaissances

Python

Advanced SQL

dbt-core

Delta Lake

DuckDB

MSSQL

PostgreSQL

Airflow

Linux/OpenShift

PowerShell

Data governance

DataHub/OpenMetadata

Outils

dbt-core

DuckDB

Delta Lake

MSSQL

PostgreSQL

Dagster

Airflow

Linux/OpenShift

PowerShell

DataHub

OpenMetadata

Description du poste

In4Matic is seeking an experienced Data Engineer to join the team and contribute to the development of a secure, on-premise data platform in a highly regulated environment. You will collaborate with architecture and BI specialists to build robust data solutions emphasizing security, governance, traceability and data sovereignty.

The role focuses on designing ingestion pipelines, implementing SCD patterns, Delta Lake and end-to-end data lineage, and exposing curated data to BI dashboards in a