Hybrid Data Engineer — Azure/Databricks Pipelines

V-IT NV; Brussel; Hybride; EUR 60 000 - 85 000; Plein temps

Résumé du poste

V-IT NV is seeking a Data Engineer to design and maintain scalable data pipelines on Azure and Databricks, transforming data from multiple sources for analytics and network studies. You will build data models, enable AI/ML datasets, and ensure governance and quality across data assets.

The role requires strong Python (Pandas/Polars), SQL, and Databricks expertise, plus experience with dashboards (Power BI/Streamlit) and collaborative tooling like Git and Confluence.

Qualifications

• Fluent in Python with project experience (Pandas/Polars).
• Advanced SQL and data access framework knowledge.
• Experience with Databricks, Azure, PySpark.
• Understanding of scalable/distributed data processing.
• Experience building data pipelines and data products.
• Experience with dashboards in Power BI or Streamlit.
• Excel and VBA proficiency.
• Git and collaborative software development.
• Bachelor-related IT/CS/Data Engineering degree; master a plus.

Responsabilités

• Design, develop and maintain scalable data pipelines on Azure and Databricks.
• Collect, transform and integrate data from internal and external sources.
• Ensure data quality, traceability and governance.
• Manage Azure Data Lake, Databricks workspaces and distributed environments.
• Develop data models and datasets for network studies and analytics.
• Enable AI/ML and analytical applications with reliable datasets.
• Monitor, automate and optimize data workflows.
• Produce technical docs in Markdown and Confluence.

Connaissances

Python (Pandas/Polars)

SQL

Databricks

Azure

PySpark

Data pipelines

Power BI

Excel/VBA

Git

Confluence

Pandas

Polars

Formation

Bachelor in IT / Computer Science / Data Engineering

Outils

Databricks

Azure

Power BI

Streamlit

Git

Confluence

Description du poste

V-IT NV is seeking a Data Engineer to design and maintain scalable data pipelines on Azure and Databricks, transforming data from multiple sources for analytics and network studies. You will build data models, enable AI/ML datasets, and ensure governance and quality across data assets.

The role requires strong Python (Pandas/Polars), SQL, and Databricks expertise, plus experience with dashboards (Power BI/Streamlit) and collaborative tooling like Git and Confluence.