Data Engineer - Azure Databricks Lakehouse & Pipelines

IVC Evidensia Belgium; De Pinte; On-site; EUR 70,000 - 95,000; Full time

Job summary

IVC Evidensia Belgium is expanding its data platform and seeks a Data Engineer to own and evolve Azure Databricks pipelines. You will ingest data from diverse sources, build Bronze/Silver/Gold layers, and partner with analysts to deliver trusted datasets for Power BI reporting.

The role emphasizes scalable architectures, data quality and cost-efficiency in a healthcare-adjacent veterinary context. As part of a cross-functional team, you will implement governance, automation and DevOps practices

Qualifications

• Proven Data Engineer experience in modern cloud data platforms.
• Hands-on Databricks and AI/BI dashboards.
• Strong SQL and Python/PySpark skills.
• Experience designing, building and maintaining ELT/ETL pipelines.
• Experience with Azure Data Factory or equivalent orchestration.
• Knowledge of medallion architecture (Bronze/Silver/Gold).

Responsibilities

• Design, build, maintain and optimise data pipelines within Azure Databricks.
• Take technical ownership of data ingestion from source systems into the Belgium data platform.
• Build and maintain Bronze, Silver and Gold data layers using a medallion architecture.
• Add and integrate new data sources, including internal systems, external datasets, APIs and file-based feeds.
• Improve pipeline performance, reliability, monitoring and observability.
• Identify opportunities to speed up data processing and reduce platform running costs.
• Support the transition from legacy reporting and data infrastructure to a modern Databricks Lakehouse platform.
• Collaborate with business users and SMEs to understand data requirements and translate them into robust technical solutions.
• Implement data quality checks, validation rules and reconciliation processes.
• Support documentation of data flows, business definitions, assumptions and technical design decisions.
• Contribute to engineering standards, reusable patterns and platform best practices.
• Work within DevOps ways of working, using version control, deployment practices and structured delivery methods.
• Support secure development practices, including access management, scalability, performance and other non-functional requirements.
• Proactively seek innovative solutions to improve the platform and automate manual processes.

Skills

Databricks

Azure

Python

PySpark

SQL

ETL/ELT pipelines

Data governance

Power BI

Git

Azure DevOps

Terraform

Bicep

APIs

Delta Lake

Unity Catalog

Multi-site data

Tools

Azure Databricks

Azure Data Factory

Delta Lake tooling

Git

Azure DevOps

Terraform

Bicep

Unity Catalog

APIs

Job description

IVC Evidensia Belgium is expanding its data platform and seeks a Data Engineer to own and evolve Azure Databricks pipelines. You will ingest data from diverse sources, build Bronze/Silver/Gold layers, and partner with analysts to deliver trusted datasets for Power BI reporting.

The role emphasizes scalable architectures, data quality and cost-efficiency in a healthcare-adjacent veterinary context. As part of a cross-functional team, you will implement governance, automation and DevOps practices