Azure Databricks Data Platform Engineer

Somerset Bridge Group; Newcastle upon Tyne; Hybrid; GBP 53,000 - 67,000; Full time

Benefits offered by this job

Hybrid working 2/3

Job summary

Somerset Bridge Group is modernising its data platform to enable analytics, reporting, and AI initiatives across Pricing, Underwriting and Claims. You will design and build scalable data pipelines on Azure Databricks and Delta Lake, with governance, security, and real-time processing at scale.

The role sits in the Enterprise Data Team and requires strong SQL and PySpark, plus experience with cloud-native data platforms. Hybrid working available, with 2 days in the office and 3 days from home.

Qualifications

• Proven experience building data pipelines with Azure Databricks and Data Factory.

Responsibilities

• Design, build and maintain scalable data pipelines using Azure Databricks, Azure Data Factory and Delta Lake to support both real-time and batch data processing.
• Create robust data models and lakehouse architectures to support analytics, reporting and machine learning initiatives.
• ,

Skills

Strong SQL

Python (PySpark)

Stakeholder communication

Problem solving

Team collaboration

Tools

Azure Databricks

Azure Data Factory

Delta Lake

Unity Catalog

Azure Monitor

Databricks Workflows

Structured Streaming

Azure DevOps

GitHub Actions

Infrastructure as Code

Job description

Somerset Bridge Group is modernising its data platform to enable analytics, reporting, and AI initiatives across Pricing, Underwriting and Claims. You will design and build scalable data pipelines on Azure Databricks and Delta Lake, with governance, security, and real-time processing at scale.

The role sits in the Enterprise Data Team and requires strong SQL and PySpark, plus experience with cloud-native data platforms. Hybrid working available, with 2 days in the office and 3 days from home.