Data Engineer – Lakehouse & Data Platform Job ID: JP055174

ITproposal; Brussel; Hybride; EUR 70 000 - 100 000; Plein temps

Résumé du poste

ITproposal in Brussels is seeking a Data Engineer to design and maintain a secure on-premise data platform in a highly regulated environment. You will join a multidisciplinary team with Data and Solution Architects and a BI Developer to build end-to-end Lakehouse solutions and robust data ingestion pipelines.

You will implement Bronze-Silver-Gold data layers, manage Delta Lake tables, and develop orchestration workflows with Dagster or Airflow, while ensuring data governance and integration with

Qualifications

• Strong Python and SQL skills.
• Proven experience with dbt-core and Delta Lake.
• Knowledge of DuckDB, MSSQL/PostgreSQL, and advanced SQL/CDC.
• Experience with Dagster, Airflow, or equivalent orchestration tools.
• Comfortable working with Linux/OpenShift and PowerShell.
• Familiarity with DataHub, OpenMetadata, or similar governance platforms.
• Experience with BI development; Power BI is a plus.
• Knowledge of Kafka/Debezium, Spark, and Lakehouse architectures is an advantage.
• Strong analytical, documentation, communication, and problem-solving skills.
• Belgian nationality is mandatory due to the nature of the assignment.

Responsabilités

• Design and develop data ingestion pipelines from files, APIs, and relational databases.
• Implement incremental and streaming data pipelines with strong reliability and traceability.
• Develop Bronze, Silver, and Gold data layers using a Medallion/Lakehouse architecture.
• Manage Delta Lake tables, including ACID transactions, time travel, and data optimization.
• Build and maintain data orchestration workflows and monitoring.
• Implement data lineage, metadata management, and governance practices.
• Develop data endpoints and support BI dashboards and reporting solutions.

Connaissances

Python

SQL

dbt-core

Delta Lake

Dagster

Airflow

OpenShift

PowerShell

DataHub

OpenMetadata

Kafka

Spark

BI dashboards

Outils

dbt-core

Delta Lake

Dagster

Airflow

OpenShift

PowerShell

DataHub

OpenMetadata

Kafka

Spark

Description du poste

About the job Data Engineer – Lakehouse & Data Platform Job ID: JP055174 Data Engineer – Lakehouse & Data Platform We are looking for an experienced Data Engineer to help build and maintain a secure, on-premise data platform in a highly regulated environment. You will work in a multidisciplinary team alongside Data and Solution Architects and a BI Developer.

Key Responsibilities

• Design and develop data ingestion pipelines from files, APIs, and relational databases.
• Implement incremental and streaming data pipelines with strong reliability and traceability.
• Develop Bronze, Silver, and Gold data layers using a Medallion/Lakehouse architecture.
• Manage Delta Lake tables, including ACID transactions, time travel, and data optimization.
• Build and maintain data orchestration workflows and monitoring.
• Implement data lineage, metadata management, and governance practices.
• Develop data endpoints and support BI dashboards and reporting solutions.

Requirements

• Strong Python and SQL skills.
• Proven experience with dbt-core and Delta Lake.
• Knowledge of DuckDB, MSSQL/PostgreSQL, and advanced SQL/CDC.
• Experience with Dagster, Airflow, or equivalent orchestration tools.
• Comfortable working with Linux/OpenShift and PowerShell.
• Familiarity with DataHub, OpenMetadata, or similar governance platforms.
• Experience with BI development; Power BI is a plus.
• Knowledge of Kafka/Debezium, Spark, and Lakehouse architectures is an advantage.
• Strong analytical, documentation, communication, and problem-solving skills.
• Belgian nationality is mandatory due to the nature of the assignment.

Location: Brussels, Belgium

Work Arrangement: Hybrid