Data engineer Azure Databricks

eXalt; Brussel Hoofdstad; Sur place; EUR 60 000 - 100 000; Plein temps

Résumé du poste

eXalt in Brussels, Belgium, is seeking a Data Engineer specialized in Azure Databricks to build and maintain data pipelines, storage structures, and data exchange endpoints for business stakeholders.

You will design and implement data enrichments using Python in a Databricks environment, create efficient storage with materialized views, and collaborate with analysts to deliver reusable, integrated solutions across the enterprise while reinforcing DevOps practices and documenting technical

Qualifications

• 3 to 5+ years of hands-on experience in at least 2 of the following areas: SQL Server, Azure Databricks / Azure Data Factory / Azure Functions / Azure DevOps, Python in Databricks, or emerging technologies
• Strong experience with Azure Databricks and the Azure data ecosystem.
• Solid command of Python and SQL for data engineering purposes.
• Ability to interact with business analysts and stakeholders in complex, multi-stakeholder environments.
• Product-oriented mindset with an iterative and analytical approach to problem-solving.

Responsabilités

• Design, develop, and maintain data pipelines using Azure Databricks, Azure Data Factory, Azure Functions, and Azure Stream/Log Analytics.
• Implement data enrichments and transformations with Python in a Databricks environment.
• Create efficient storage structures and materialized views across analytical technologies.
• Develop data exchange endpoints for end users and business teams.
• Interact with data governance tools (Glossary, Modeling, Lineage, Data Quality).
• Collaborate with business analysts and stakeholders to refine requirements and present reusable, integrated solutions.
• Contribute to extensive testing and reinforce DevOps principles within the team.
• Participate in writing and structuring technical documentation.
• Continuously look at data in a transversal way across the enterprise.

Connaissances

SQL

Python

English fluency

Team collaboration

Outils

Azure Databricks

Azure Data Factory

Azure Functions

Azure DevOps

Python in Databricks

Power BI

SAP data integration

Description du poste

As a Data Engineer specialized in Azure Databricks, you’ll play a key role in building and maintaining data pipelines, efficient storage structures, and data exchange endpoints for the benefit of business stakeholders.

In concrete terms, you will:

• Design, develop, and maintain data pipelines using Azure Databricks, Azure Data Factory, Azure Functions, and Azure Stream/Log Analytics.

• Implement data enrichments and transformations with Python in a Databricks environment.

• Create efficient storage structures and powerful materialized views across different analytical technologies.

• Develop data exchange endpoints for end users and business teams.

• Interact with data governance tools (Glossary, Modeling, Lineage, Data Quality).

• Collaborate with business analysts and stakeholders to refine requirements and present reusable, integrated solutions.

• Contribute to extensive testing and reinforce DevOps principles within the team.

• Participate in the writing and structuring of technical documentation.

• Continuously look at data in a transversal way (no silos), across the entire enterprise, to maximize coherence, reuse, and adoption.

Must have:

• 3 to 5+ years of hands‑on experience in at least 2 of the following areas: SQL Server, Azure Databricks / Azure Data Factory / Azure Functions / Azure DevOps, Python in Databricks, or emerging technologies (Redis, RabbitMQ, Neo4j, Apache Arrow…)
• Strong experience with Azure Databricks and the Azure data ecosystem.
• Solid command of Python and SQL for data engineering purposes.
• Ability to interact with business analysts and stakeholders in complex, multi‑stakeholder environments.
• Product-oriented mindset with an iterative and analytical approach to problem‑solving.
• Team player who values respect, open‑mindedness, challenge, and innovation.
• Customer-oriented with excellent communication skills.
• Fluent in English (must have) AND fluent in French and/or Dutch.

Nice to have:

• Experience with Power BI.
• Experience with SAP data integration.
• Knowledge of Azure DevOps and CI/CD practices.