Senior Azure Data Engineer - Lakehouse & Databricks Lead

AETHER

Brussel Hoofdstad

On-site

EUR 90,000 - 120,000

Full time

12 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AETHER is seeking a senior Azure Data Engineer in Belgium to design, develop, and maintain scalable data solutions on Microsoft Azure. You will work on data pipelines with Azure Data Factory and Databricks, implement Delta Lake/Lakehouse patterns, and govern data using Unity Catalog. Excellence in SQL, Spark/PySpark, Python, and Power BI is required.

Fluent in French/Dutch with English proficiency; 11‑month commitment from Jan 4 to Dec 31, 2027. Belgian work permit is a plus.

Qualifications

Degree in Computer Science, Data Engineering, or a related field.
5+ years of experience in a similar role.
Proven experience with Azure Databricks, Unity Catalog, and Azure data architecture.
Expert-level skills in SQL, Databricks, Spark, Python, Azure Data Factory, Azure Data Architecture, and Databricks Unity Catalog.
Advanced skills in Power BI.
Strong experience with Azure Data Factory, Azure Databricks, Azure Storage, Azure SQL, Key Vault, and Azure DevOps.
Hands‑on experience with Databricks Unity Catalog, including access management, security, and data governance.
Strong knowledge of Azure Databricks architecture, including Lakehouse design, scalability, security, and best practices.
Experience with Spark, PySpark, and Delta Lake.
Experience with monitoring, performance tuning, and cost optimization in Azure and Databricks.
Knowledge of CI/CD principles applied to data engineering.
Knowledge of application integration patterns, including REST API and AMQP.
Analytical mindset, autonomy, problem‑solving skills, and team spirit.
Strong communication skills and the ability to explain technical concepts clearly.
Bilingual French and Dutch, and professional working proficiency in English.
Availability for an 11-month assignment in Belgium, from 4 January to 31 December 2027.
Microsoft Azure or Databricks certifications are a plus.
Experience with Power BI administration and governance is a plus.
Experience with real-time data streaming is a plus.
Experience with Terraform or Infrastructure as Code is a plus.
Familiarity with Azure Monitor and Log Analytics is a plus.
Basic SAP knowledge, including S/4HANA or BW/4HANA as data sources, is a plus.
Experience working in Agile/Scrum environments is a plus.
An entrepreneurial experience or ambition is a plus, including extra‑professional or extra‑academic activities.
Fast availability is preferred.
Valid single permit required for non‑EU citizens.

Responsibilities

Design, develop, and maintain reliable, scalable data solutions on Microsoft Azure.
Improve platform architecture, data governance, self-service access, performance, security, and costs.
Design and develop data pipelines using Azure Data Factory, Databricks, and other Azure services.
Implement modern data architectures using Data Lake, Delta Lake, and Lakehouse approaches.
Develop and industrialize new business use cases to run reliably in production.
Contribute to Databricks Unity Catalog, including catalogs, schemas, permissions, data sharing, and governance.
Support the implementation of a self-service data strategy for business teams.
Monitor and optimize Azure and Databricks performance, resource use, and costs.
Automate data ingestion, transformation, and deployment processes.
Collaborate with Data Analysts, Data Scientists, and business stakeholders.
Document data flows, architecture, and best practices.
Maintain and continuously improve the Azure Data Platform.