Data Engineer – Databricks & Python

Pauwels Consulting; Brussel; Hybride; EUR 60 000 - 90 000; Plein temps

Résumé du poste

Pauwels Consulting is seeking a data engineer to help build a modern data platform by exploring AI technologies and designing scalable ETL pipelines. You will integrate databases and APIs, work with Databricks/Spark, and implement IaC in a hybrid Brussels-based setup.

The role requires 3+ years in data engineering, proficiency in Python/Java/Scala, and Dutch at C2 level. Start mid-September for a 10-month engagement with a flexible contract.

Qualifications

• 3+ years of experience as a data engineer.
• Experience with Python, Java or Scala for developing datastreams and ETL processes.
• Hands-on with Databricks, Spark and PySpark for processing large datasets.
• Experience with data lake solutions such as Azure Data Lake or Delta Lake.
• Experience using DBT for data transformation and modeling.
• Experience with Terraform or Pulumi for IaC.
• Experience connecting data sources via REST APIs and various databases.
• Proactive and solution-oriented in a fail-fast environment.
• Fluent in Dutch with a C2 level.

Responsabilités

• Explore and validate new data and AI technologies through short-cycle feasibility projects.
• Design and implement scalable ETL processes and data pipelines.
• Integrate diverse data sources such as databases and APIs into the central analytics platform.
• Collaborate in multidisciplinary teams to test hypotheses and demonstrate technical potential.
• Maintain data consistency, quality, and reliability across the entire pipeline lifecycle.
• Implement Infrastructure as Code (IaC) to support and manage data environments.

Connaissances

Dutch (C2)

Problem solving

Proactive

Outils

Python

Java

Scala

Databricks

Spark

PySpark

Azure Data Lake

Delta Lake

DBT

Terraform

Pulumi

REST APIs

Description du poste

Our client, a prominent organization in the public sector, is looking for a professional to join their analytics division. The role involves developing AI and analytical building blocks for a modern data platform by exploring and validating new technologies through iterative feasibility studies.

• Explore and validate new data and AI technologies through short-cycle feasibility projects.
• Design and implement scalable ETL processes and data pipelines.
• Integrate diverse data sources such as databases and APIs into the central analytics platform.
• Collaborate in multidisciplinary teams to test hypotheses and demonstrate technical potential.
• Maintain data consistency, quality, and reliability across the entire pipeline lifecycle.
• Implement Infrastructure as Code (IaC) to support and manage data environments.

• 3+ years of experience as a data engineer.
• You have experience with Python, Java, or Scala for developing datastreams and ETL processes.
• You possess hands-on experience with Databricks, Spark, and PySpark for processing large datasets.
• You bring experience with data lake solutions such as Azure Data Lake or Delta Lake.
• You have experience using DBT for data transformation and modeling.
• You possess experience with Terraform or Pulumi for IaC.
• You have experience connecting data sources via REST APIs and various database systems.
• You're proactive and solution-oriented in a fail-fast environment.
• You are fluent in Dutch with a C2 level.

Nice to Haves

• Familiarity with governmental data standards.

• Start date: 15/09/2026
• Duration: 10 months
• Work regime: Full-time
• Location: Brussels
• Working model: Hybrid
• Contract: open to both permanent employees and freelancers