Azure Data Engineer

Us3 Consulting; Brussel; Hybride; EUR 75 000 - 110 000; Plein temps

Résumé du poste

Us3 Consulting in Brussels is seeking an experienced Azure Data Engineer to design, build, and maintain scalable data pipelines and analytics solutions. The role requires hands-on experience with Databricks, dbt, Spark, Python, Azure Data Factory, SQL Server, and Power BI.

Ideal candidates will have 6+ years of Azure Databricks experience and 2+ years with Spark, along with knowledge of SSIS/SSRS as a plus.

Qualifications

• Bachelor's degree in Computer Science, IT, or related field.
• 3–8+ years of experience in Data Engineering or BI.
• Microsoft Azure certifications are a plus.
• 6+ years of work experience with Azure Databricks.
• 2+ years of work experience with Apache Spark.

Responsabilités

• Design, build, and optimize ETL/ELT pipelines using ADF and Databricks.
• Develop scalable data processing with Apache Spark (PySpark).
• Create and maintain data transformation models with dbt.
• Write optimized SQL queries, stored procedures in SQL Server.
• Develop Python scripts for ingestion, transformation, and automation.
• Build and maintain data warehouses and data lakes.
• Develop dashboards and reports using Power BI.
• Monitor, troubleshoot, and optimize data pipelines for performance.
• Collaborate with stakeholders to deliver data solutions.
• Implement data quality, governance, and security best practices.
• Maintain technical documentation and support deployments.

Connaissances

Databricks

dbt

PySpark

Python

Azure Data Factory

SQL Server

Power BI

Git

CI/CD

Data warehousing

Formation

Bachelor's degree in Computer Science/IT

Outils

Delta Lake

Azure DevOps

Azure Synapse Analytics

Unity Catalog

Git

CI/CD pipelines

Description du poste

Azure Data Engineer (Databricks, Spark, dbt, SQL Server)

Brussels area, Belgium (Hybrid)

Job Description

We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and analytics solutions. The ideal candidate will have hands‑on experience with Databricks, dbt, Apache Spark, Python, Azure Data Factory, SQL Server, and Power BI, with knowledge of SSIS/SSRS being an added advantage.

Key Responsibilities

• Design, build, and optimize ETL/ELT data pipelines using Azure Data Factory and Databricks.
• Develop scalable data processing solutions using Apache Spark (PySpark).
• Create and maintain data transformation models using dbt.
• Write optimized SQL queries, stored procedures, and database objects in SQL Server.
• Develop Python scripts for data ingestion, transformation, and automation.
• Build and maintain data warehouses and data lakes.
• Develop dashboards and reports using Power BI.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Collaborate with business stakeholders, analysts, and developers to deliver data solutions.
• Implement data quality, governance, and security best practices.
• Maintain technical documentation and support production deployments.

Required Skills

• Strong experience with Databricks.
• Hands‑on experience with dbt.
• Strong knowledge of Apache Spark (PySpark).
• Proficiency in Python.
• Experience with Azure Data Factory.
• Advanced SQL Server development skills.
• Experience creating reports and dashboards in Power BI.
• Understanding of data warehousing concepts and ETL/ELT processes.
• Experience with Git and CI/CD practices.

Preferred Skills

• Experience with SSIS and/or SSRS.
• Experience with Azure Synapse Analytics.
• Knowledge of Delta Lake, Unity Catalog, and Azure DevOps.
• Familiarity with Agile/Scrum methodologies.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 3–8+ years of experience in Data Engineering or Business Intelligence.
• Microsoft Azure certifications are a plus.

Requirements added by the job poster

• 6+ years of work experience with Azure Databricks
• 2+ years of work experience with Apache Spark