Azure Data Engineer - Remote Databricks & Lakehouse Lead

Aon plc

United States

Remote

USD 120,000 - 160,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Aon plc in Krakow is seeking an Azure Data Engineer to design and deliver scalable data pipelines and Lakehouse solutions on Azure, leveraging PySpark, SQL, Delta Lake, Unity Catalog and Power BI enablement to empower enterprise analytics.

The role combines hands-on engineering with technical leadership across governance, performance, and CI/CD for Databricks, with 50/50 hybrid or fully remote options, and a focus on secure, reliable data platforms.

Qualifications

  • Experience designing scalable ETL/ELT pipelines on Azure Databricks with PySpark, SQL and Delta Lake.
  • Proficiency in building Lakehouse architectures and governance using Unity Catalog.
  • Ability to develop performance-optimized datasets for BI tools like Power BI.
  • Experience with CI/CD practices using Git, Azure DevOps or GitHub.
  • Knowledge of finance/insurance domains is a plus.

Responsibilities

  • Facilitate workshops to discuss business reporting requirements.
  • Establish best practices across data architecture, governance, security, performance, and reliability.
  • Develop scalable data integration pipelines on Azure Databricks using PySpark, SQL, Notebooks, Jobs, and Workflows.
  • Build and maintain Lakehouse architectures with Delta Lake across bronze/silver/gold layers.
  • Implement Unity Catalog for centralized data governance and access control.
  • Define data contracts and collaborate with BI developers on semantic models and refresh strategies.
  • Optimize queries and troubleshoot Power BI–Databricks integrations (Direct Lake/Direct Query).
  • Configure Databricks clusters, policies, and job schedules for cost and reliability.
  • Contribute to CI/CD pipelines for Databricks code and explore ML pipelines.

Skills

Azure Databricks
PySpark
SQL
Delta Lake
Unity Catalog
Power BI
ETL/ELT pipelines
CI/CD
Notebooks/Jobs/Workflows
Data governance

Tools

Git
GitHub
Azure DevOps
Databricks

Job description

Aon plc in Krakow is seeking an Azure Data Engineer to design and deliver scalable data pipelines and Lakehouse solutions on Azure, leveraging PySpark, SQL, Delta Lake, Unity Catalog and Power BI enablement to empower enterprise analytics.

The role combines hands-on engineering with technical leadership across governance, performance, and CI/CD for Databricks, with 50/50 hybrid or fully remote options, and a focus on secure, reliable data platforms.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer
Azure Data Engineer

Aon plc • United States

Remote
USD 120,000 - 160,000
Azure Data Platform Lead (Databricks/Lakehouse)
Azure Data Platform Lead (Databricks/Lakehouse)

Aroha Technologies, Inc • Greenfield (IN)

On-site
USD 120,000 - 180,000
Azure Databricks Data Engineer - Lakehouse & Pipelines
Azure Databricks Data Engineer - Lakehouse & Pipelines

Ethereum Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 160,000
Azure Databricks Data Engineer – Spark & Lakehouse
Azure Databricks Data Engineer – Spark & Lakehouse

Signature IT World • Pennsylvania

Hybrid
USD 120,000 - 150,000
Remote Databricks Data Engineer — AI & Lakehouse Architect
Remote Databricks Data Engineer — AI & Lakehouse Architect

Livefront, Inc. • Peru (IL)

Remote
USD 90,000 - 140,000
Azure Databricks Lakehouse Architect
Azure Databricks Lakehouse Architect

Programmers • Minneapolis (MN)

On-site
USD 120,000 - 150,000
Azure Databricks Data Engineer — Lakehouse & Spark Expert
Azure Databricks Data Engineer — Lakehouse & Spark Expert

Quantum Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 180,000
Senior Azure Databricks Engineer - Remote, Lakehouse Expert
Senior Azure Databricks Engineer - Remote, Lakehouse Expert

Dataflix • United States

Remote
USD 130,000 - 170,000
Senior Databricks Data Engineer - Remote, Lakehouse/Delta
Senior Databricks Data Engineer - Remote, Lakehouse/Delta

Entrada • United States

Remote
USD 120,000 - 180,000
MacBook provided
Referral bonus
Databricks cert coverage
+3
Senior Azure Databricks Lakehouse Architect
Senior Azure Databricks Lakehouse Architect

Programmers • Minneapolis (MN)

On-site
USD 120,000 - 170,000