Data Engineer

V-IT NV; Brussel; Hybride; EUR 60 000 - 85 000; Plein temps

Résumé du poste

V-IT NV is seeking a Data Engineer to design and maintain scalable data pipelines on Azure and Databricks, transforming data from multiple sources for analytics and network studies. You will build data models, enable AI/ML datasets, and ensure governance and quality across data assets.

The role requires strong Python (Pandas/Polars), SQL, and Databricks expertise, plus experience with dashboards (Power BI/Streamlit) and collaborative tooling like Git and Confluence.

Qualifications

• Fluent in Python with project experience (Pandas/Polars).
• Advanced SQL and data access framework knowledge.
• Experience with Databricks, Azure, PySpark.
• Understanding of scalable/distributed data processing.
• Experience building data pipelines and data products.
• Experience with dashboards in Power BI or Streamlit.
• Excel and VBA proficiency.
• Git and collaborative software development.
• Bachelor-related IT/CS/Data Engineering degree; master a plus.

Responsabilités

• Design, develop and maintain scalable data pipelines on Azure and Databricks.
• Collect, transform and integrate data from internal and external sources.
• Ensure data quality, traceability and governance.
• Manage Azure Data Lake, Databricks workspaces and distributed environments.
• Develop data models and datasets for network studies and analytics.
• Enable AI/ML and analytical applications with reliable datasets.
• Monitor, automate and optimize data workflows.
• Produce technical docs in Markdown and Confluence.

Connaissances

Python (Pandas/Polars)

SQL

Databricks

Azure

PySpark

Data pipelines

Power BI

Excel/VBA

Git

Confluence

Pandas

Polars

Formation

Bachelor in IT / Computer Science / Data Engineering

Outils

Databricks

Azure

Power BI

Streamlit

Git

Confluence

Description du poste

For a customer we are looking for a Data Engineer.

Start date: As soon as possible
Duration: Until 31-12-2027
Location: Brussels, 3 days onsite & 2 days remote

Context of the assignment

Within Grid Development, the digital, data and analytical foundations are laid for smarter investment decisions and more resilient grid planning. The SGS (Scenarios & Grid Studies Solutions) product line provides the digital capabilities for the entire lifecycle of scenario and network study management. The consultant will strengthen this product team.

Tasks and responsibilities:

Designing, developing and maintaining scalable data pipelines on Azure and Databricks.
Collection, transformation and integration of data from internal and external sources.
Ensuring data quality, consistency, traceability and governance.
Manage and optimize Azure Data Lake, Databricks workspaces and distributed processing environments.
Developing data models and datasets for network studies, scenario management and business analytics.
Enabling AI / ML and advanced analytical applications with reliable, controlled datasets.
Monitoring, automation and performance optimization of data workflows.
Technical documentation in Markdown and Confluence.

Profile requirements:

Mandatory skills:
Fluent in Python (Pandas, Polars) with demonstrable project experience.
Advanced knowledge of SQL and data access frameworks.
Experience with outscaling technologies: Databricks, Azure, PySpark.
Good understanding of scalable and distributed data processing.
Experience in building and maintaining data pipelines, analytical data sets and data products.
Experience with dashboards and reporting in Power BI or Streamlit.
Advanced knowledge of Excel and VBA.
Experience with Git and collaborative software development.
Bachelor in IT / Computer Science / Data Engineering or equivalent (master is a plus).
Desired skills:
Knowledge of R, in particular data.table.
Understanding AI / ML concepts and AI-supported data solutions.
Experience in the energy sector, power systems or grid planning.
Experience with documenting in Markdown and Confluence.

Languages:

Fluent English; Dutch and / or French is a strong advantage.