Cloud Lakehouse Data Engineer (Azure Databricks, Python)

Cpl Group; Dublin; On-site; EUR 110,000 - 160,000; Full time

Job summary

Cpl Group is seeking a hands-on Data Warehouse Python Developer to join the Ireland-based Data Warehouse team. You will enhance, optimise, and modernise the Enterprise DWH, delivering cloud-based solutions using Azure Databricks, Microsoft Fabric, SQL Server, and Python while migrating on-premise to a Lakehouse architecture.

You will work with business stakeholders and cross-functional teams to design scalable data solutions, ensure operational stability, and participate in Agile delivery and

Qualifications

• 10+ years in Data Warehouse development and SQL Server development.
• Proven track record delivering enterprise-scale Data Warehouse and data engineering solutions.
• Extensive hands-on experience as Data Warehouse Developer and Python Developer.

Responsibilities

• Design, develop, and support data solutions using Azure Databricks and Microsoft Fabric.
• Build and optimise cloud-based ETL/ELT pipelines and data integration processes.
• Develop Python-based data engineering, automation, monitoring, and orchestration solutions.
• Modernise the Enterprise Data Warehouse to a cloud-native Lakehouse architecture.
• Ensure data governance, security, and operational standards.

Skills

Data warehouse development

Python programming

ETL/ELT design

SQL Server development

Cloud data engineering

Data modelling

Education

BSc in Computer Science / Software Engineering

Postgraduate qualification in a relevant technology (desirable)

Tools

Azure Databricks

Microsoft Fabric

SQL Server

AutoSys / JIL scripting

Job description

Cpl Group is seeking a hands-on Data Warehouse Python Developer to join the Ireland-based Data Warehouse team. You will enhance, optimise, and modernise the Enterprise DWH, delivering cloud-based solutions using Azure Databricks, Microsoft Fabric, SQL Server, and Python while migrating on-premise to a Lakehouse architecture.

You will work with business stakeholders and cross-functional teams to design scalable data solutions, ensure operational stability, and participate in Agile delivery and