Azure Databricks Data Engineer - Lakehouse & Governance

Aon plc; Polska; Hybride; PLN 180 000 - 260 000; Plein temps

Résumé du poste

Aon plc is seeking an Azure Data Engineer to design and deliver scalable data pipelines and governed data platforms on Azure. The role focuses on PySpark, SQL, Delta Lake, Unity Catalog, and enabling Power BI across the organization.

Based in Krakow with a 50/50 hybrid or fully remote model, the position requires expertise in building Lakehouse architectures and establishing best practices for data governance, security, and performance.

Qualifications

• Strong experience building scalable ETL/ELT pipelines on Azure Databricks using PySpark, SQL, notebooks, jobs, and workflows.
• Experience implementing Lakehouse architectures with Delta Lake (bronze/silver/gold layers).
• Proven ability to define governance, security, performance, and reliability across data platforms.

Responsabilités

• Facilitate workshops to gather reporting requirements and translate them into scalable data pipelines.
• Develop and maintain Lakehouse architectures with Delta Lake across data layers.
• Implement and manage Unity Catalog, RBAC, access controls, auditing, and catalog standards.
• Collaborate with BI developers to optimize data models and semantic layers for Power BI.
• Configure Databricks clusters, jobs, and CI/CD pipelines using Git and Azure DevOps or GitHub.

Connaissances

PySpark

SQL

Delta Lake

Unity Catalog

Power BI

Azure Databricks

Outils

Git

Azure DevOps

GitHub

Description du poste

Aon plc is seeking an Azure Data Engineer to design and deliver scalable data pipelines and governed data platforms on Azure. The role focuses on PySpark, SQL, Delta Lake, Unity Catalog, and enabling Power BI across the organization.

Based in Krakow with a 50/50 hybrid or fully remote model, the position requires expertise in building Lakehouse architectures and establishing best practices for data governance, security, and performance.