Senior Python DW Engineer for Cloud Lakehouse

Cpl; Dublin; Hybrid; EUR 90,000 - 120,000; Full time

Benefits offered by this job

Hybrid and flexible working

Private medical cover

Life & disability cover

Wellbeing support & counselling

Generous annual leave

Learning & career development

Job summary

Cpl, partnering with a leading financial services organisation, seeks an experienced Data Warehouse Developer to move a SQL Server warehouse to a modern cloud Lakehouse. You will design, build and maintain data pipelines, drive migration initiatives and own critical SQL + Python workflows in a hybrid working setup.

You will lead with strong T-SQL, Python and cloud data skills, collaborating with stakeholders across Agile teams to ensure performance, security and governance while delivering

Qualifications

• 7+ years’ experience in data warehouse and SQL Server development.
• Hands-on with Azure Databricks and Microsoft Fabric.
• Advanced T-SQL and strong Python programming skills.
• Proven experience delivering Lakehouse, cloud migration or modernisation projects.
• Solid ETL/ELT, data modelling and performance tuning skills.
• Experience supporting business-critical production systems.
• Knowledge of CI/CD and DevOps practices.
• Strong communication and stakeholder skills, with the ability to work independently.

Responsibilities

• Design, build and support cloud data solutions using Azure Databricks and Microsoft Fabric.
• Develop and optimise ETL/ELT pipelines and data integration processes.
• Maintain and tune SQL Server databases, stored procedures and views.
• Write Python for automation, orchestration, monitoring and data quality.
• Contribute to the move to a Medallion Lakehouse architecture.
• Manage job scheduling and workflow automation (AutoSys/JIL).
• Resolve production incidents and provide on-call support.
• Collaborate with business stakeholders, analysts and engineers in Agile teams.
• Shape architecture decisions and uphold governance, security and audit standards.

Skills

Python programming

T-SQL

Stakeholder communication

Independent work

Tools

Azure Databricks

Microsoft Fabric

Azure DevOps

Power BI

Job description

Cpl, partnering with a leading financial services organisation, seeks an experienced Data Warehouse Developer to move a SQL Server warehouse to a modern cloud Lakehouse. You will design, build and maintain data pipelines, drive migration initiatives and own critical SQL + Python workflows in a hybrid working setup.

You will lead with strong T-SQL, Python and cloud data skills, collaborating with stakeholders across Agile teams to ensure performance, security and governance while delivering