(Senior) Azure Data Engineer

AETHER; Oudergem; Presencial; EUR 70 000 - 105 000; Tempo integral

Resumo da oferta

AETHER is seeking a senior Azure Data Engineer for an 11-month Belgium assignment to design, develop, and maintain reliable data solutions on Microsoft Azure. You will improve platform architecture, governance, self-service access, performance, security, and cost efficiency across the data platform.

Responsibilities include building pipelines with Azure Data Factory and Databricks, implementing Delta Lake and Lakehouse architectures, and collaborating with analysts and business partners to

Qualificações

• Degree in Computer Science or related field.
• 5+ years in a similar data engineering role.
• Proven Azure Databricks, Unity Catalog, and Azure data architecture experience.
• Strong SQL, Python, Spark, and data orchestration skills.

Responsabilidades

• Design and develop scalable data pipelines on Azure (Data Factory, Databricks).
• Apply Delta Lake and Lakehouse concepts for robust data architectures.
• Implement Databricks Unity Catalog governance and access controls.
• Collaborate with analysts, scientists, and stakeholders to deliver self-service data solutions.
• Monitor and optimize Azure Databricks performance and costs.
• Document data flows, architectures, and best practices.

Conhecimentos

SQL

Python

Spark

Azure Data Factory

Azure Databricks

Data Lake

Data governance

Cost optimization

Communication

English proficiency

Formação académica

Bachelor's in CS or related

Ferramentas

Power BI

Azure SQL

Key Vault

Terraform

Databricks Unity Catalog

Descrição da oferta de emprego

Context

AETHER is a key partner for intrapreneurial projects in Belgium, and we want to reinforce our support of key actors in the public transportation sector, who are facing interesting challenges regarding the secure and efficient use of data to support business decisions.

New projects are therefore ongoing to ensure that business teams can access reliable data for reporting and analysis while keeping access rights and platform costs under control.

Hence why we are looking for a senior Azure Data Engineer to strengthen our team of Project Partners.

Context

AETHER is a key partner for intrapreneurial projects in Belgium, and we want to reinforce our support of key actors in the public transportation sector, who are facing interesting challenges regarding the secure and efficient use of data to support business decisions.

New projects are therefore ongoing to ensure that business teams can access reliable data for reporting and analysis while keeping access rights and platform costs under control.

Hence why we are looking for a senior Azure Data Engineer to strengthen our team of Project Partners.

Task Description

As an AETHER Project Partner embedded within the project team, your objective will be to design, develop, and maintain reliable, scalable data solutions on Microsoft Azure while improving platform architecture, data governance, self-service access, performance, security, and costs.

Key Responsibilities Might Include

• Design and develop data pipelines using Azure Data Factory, Databricks, and other Azure services.
• Implement modern data architectures using Data Lake, Delta Lake, and Lakehouse approaches.
• Develop and industrialize new business use cases so they can run reliably in production.
• Contribute to implementing and managing Databricks Unity Catalog, including catalogs, schemas, permissions, data sharing, and governance.
• Support the implementation of a self-service data strategy for business teams.
• Monitor and optimize Azure and Databricks performance, resource use, and costs.
• Automate data ingestion, transformation, and deployment processes.
• Collaborate with Data Analysts, Data Scientists, and business stakeholders.
• Document data flows, architecture, and best practices.
• Contribute to maintaining and continuously improving the Azure Data Platform.

Profile

• Degree in Computer Science, Data Engineering, or a related field.
• At least 5 years of experience in a similar role.
• Proven experience with Azure Databricks, Unity Catalog, and Azure data architecture.
• Expert-level skills in SQL, Databricks, Spark, Python, Azure Data Factory, Azure Data Architecture, and Databricks Unity Catalog.
• Advanced skills in Power BI.
• Strong experience with Azure Data Factory, Azure Databricks, Azure Storage, Azure SQL, Key Vault, and Azure DevOps.
• Hands-on experience with Databricks Unity Catalog, including access management, security, and data governance.
• Strong knowledge of Azure Databricks architecture, including Lakehouse design, scalability, security, and best practices.
• Experience with Spark, PySpark, and Delta Lake.
• Experience with monitoring, performance tuning, and cost optimization in Azure and Databricks.
• Knowledge of CI/CD principles applied to data engineering.
• Knowledge of application integration patterns, including REST API and AMQP.
• Analytical mindset, autonomy, problem-solving skills, and team spirit.
• Strong communication skills and the ability to explain technical concepts clearly.
• Bilingual French and Dutch, and professional working proficiency in English.
• Availability for an 11-month assignment in Belgium, from 4 January to 31 December 2027.
• Microsoft Azure or Databricks certifications are a plus.
• Experience with Power BI administration and governance is a plus.
• Experience with real-time data streaming is a plus.
• Experience with Terraform or Infrastructure as Code is a plus.
• Familiarity with Azure Monitor and Log Analytics is a plus.
• Basic SAP knowledge, including S/4HANA or BW/4HANA as data sources, is a plus.
• Experience working in Agile/Scrum environments is a plus.
• An entrepreneurial experience or ambition is a plus, including extra-professional or extra-academic activities.
• Fast availability is preferred.
• Valid single permit required for non-EU citizens.

Our Vision

Success in industry often relies on key individuals who demonstrate intrapreneurial leadership - those who continuously initiate, transform, and pursue excellence.

The best way to develop this strength is through ad interim projects, i.e. working as a consultant with established intrapreneurs in international companies, to support their major expansion or improvement initiatives regarding governance, studies, or operations.

Since 2014, AETHER is managing these opportunities for outstanding consultants in key international groups, as these offer greater learning opportunities with multi-million impacts.

INSPIRE | LEAD GROWTH | CREATE IMPACT