Data Engineer | Databricks & Python | Hybrid (Brussels)

Pauwels Consulting; Brussel; Hybride; EUR 60 000 - 90 000; Plein temps

Résumé du poste

Pauwels Consulting is seeking a data engineer to help build a modern data platform by exploring AI technologies and designing scalable ETL pipelines. You will integrate databases and APIs, work with Databricks/Spark, and implement IaC in a hybrid Brussels-based setup.

The role requires 3+ years in data engineering, proficiency in Python/Java/Scala, and Dutch at C2 level. Start mid-September for a 10-month engagement with a flexible contract.

Qualifications

• 3+ years of experience as a data engineer.
• Experience with Python, Java or Scala for developing datastreams and ETL processes.
• Hands-on with Databricks, Spark and PySpark for processing large datasets.
• Experience with data lake solutions such as Azure Data Lake or Delta Lake.
• Experience using DBT for data transformation and modeling.
• Experience with Terraform or Pulumi for IaC.
• Experience connecting data sources via REST APIs and various databases.
• Proactive and solution-oriented in a fail-fast environment.
• Fluent in Dutch with a C2 level.

Responsabilités

• Explore and validate new data and AI technologies through short-cycle feasibility projects.
• Design and implement scalable ETL processes and data pipelines.
• Integrate diverse data sources such as databases and APIs into the central analytics platform.
• Collaborate in multidisciplinary teams to test hypotheses and demonstrate technical potential.
• Maintain data consistency, quality, and reliability across the entire pipeline lifecycle.
• Implement Infrastructure as Code (IaC) to support and manage data environments.

Connaissances

Dutch (C2)

Problem solving

Proactive

Outils

Python

Java

Scala

Databricks

Spark

PySpark

Azure Data Lake

Delta Lake

DBT

Terraform

Pulumi

REST APIs

Description du poste

Pauwels Consulting is seeking a data engineer to help build a modern data platform by exploring AI technologies and designing scalable ETL pipelines. You will integrate databases and APIs, work with Databricks/Spark, and implement IaC in a hybrid Brussels-based setup.

The role requires 3+ years in data engineering, proficiency in Python/Java/Scala, and Dutch at C2 level. Start mid-September for a 10-month engagement with a flexible contract.