Senior Data Platform Engineer - Azure Databricks Lakehouse

Source Group International; Greater London; Vor Ort; GBP 90.000 - 125.000; Vollzeit

Zusammenfassung

Source Group International in London is seeking a Senior Data Engineer to design, build, and maintain enterprise data products within an Azure Databricks lakehouse. The role emphasizes Silver and Gold layer transformations using Medallion Architecture and strong data governance.

You will collaborate with underwriters, actuaries, and technology teams, delivering Power BI dashboards and ensuring data quality, governance, and scalable solutions.

Qualifikationen

• 10+ years of Data Engineering experience, ideally in insurance
• Proven delivery of enterprise data platforms and business-facing data products
• Strong stakeholder management across business and technology teams
• Experience with underwriters, actuaries, or other business stakeholders
• Strong data modelling, governance, and Agile delivery understanding
• Excellent communication to explain technical concepts to non-technical audiences
• Bachelor's degree in a technical, scientific, mathematical, or business-related discipline (or equivalent)

Aufgaben

• Design, build, and maintain data products within an Azure Databricks lakehouse environment
• Build and optimise Silver and Gold layer transformations using Medallion Architecture principles
• Contribute to data modelling and architecture discussions
• Investigate and resolve data quality and platform issues
• Develop reporting and analytics solutions using Power BI and Databricks
• Partner with business and technical stakeholders to deliver high-quality data products
• Support code reviews, modelling reviews, and engineering best practices
• Ensure solutions are scalable, reusable, and aligned with governance standards
• Communicate technical solutions, trade-offs, and recommendations to stakeholders

Kenntnisse

Advanced SQL

PySpark

Stakeholder management

Communication

Agile delivery

Data governance

Data modelling

Presentation to non-technical

Ausbildung

Bachelor's degree in technical/scientific/business-related discipline

Tools

Azure Databricks

Delta Lake

Medallion Architecture

Data lakehouse

Power BI

Databricks Dashboards

Data quality tooling

Azure data platform technologies

Version control

Agile/Scrum

Governance

Jobbeschreibung

Source Group International in London is seeking a Senior Data Engineer to design, build, and maintain enterprise data products within an Azure Databricks lakehouse. The role emphasizes Silver and Gold layer transformations using Medallion Architecture and strong data governance.

You will collaborate with underwriters, actuaries, and technology teams, delivering Power BI dashboards and ensuring data quality, governance, and scalable solutions.