Data Engineer - Azure Databricks & Delta Lake

SSE PLC; Reading, Perth, Glasgow; On-site; GBP 36,000 - 54,000; Full time

Benefits offered by this job

Private healthcare discounts

Gym discounts

Online GP

Counselling service

Cycle to Work

Tech/Transport loans

Maternity & Adoption pay

Paternity leave

Job summary

SSE is seeking a Data Engineer to design, develop and optimise ELT/ETL pipelines across Azure Databricks, Delta Lake and Databricks SQL. You will model data for analytics and collaborate with data architects, analysts and product teams to deliver reliable data products.

The role sits in the Data & AI team, delivering the Renewables Data Platform on Databricks and migrating solutions from Synapse. It is hands-on, with 50% travel to Reading, Perth or Glasgow, and a permanent, full-time,

Qualifications

• Experience delivering data solutions in a growing business environment with varied data needs.
• Strong communication skills with both technical and non-technical stakeholders.
• Proactive and adaptable mindset with willingness to learn and grow.
• Proven data engineering experience building batch/streaming pipelines with Databricks.
• Technical capability in Python, PySpark and SQL for transformations and BI data models.

Responsibilities

• Build and maintain metadata-driven pipelines using Azure Databricks to ingest and transform data.
• Develop Delta Lake layers (bronze/silver/gold) and BI-ready data models with Power BI.
• Use Databricks pipelines, jobs, notebooks, PySpark and SQL for large-scale transformations.
• Support governance, security, and data contracts with Unity Catalog and permissions.
• Collaborate with DevOps and product teams to enable CI/CD and continuous skill growth.

Skills

Data pipeline development

Stakeholder communication

Analytical thinking

Tools

Azure Databricks

Delta Lake

Databricks SQL

PySpark

Python

SQL

Power BI

Job description

SSE is seeking a Data Engineer to design, develop and optimise ELT/ETL pipelines across Azure Databricks, Delta Lake and Databricks SQL. You will model data for analytics and collaborate with data architects, analysts and product teams to deliver reliable data products.

The role sits in the Data & AI team, delivering the Renewables Data Platform on Databricks and migrating solutions from Synapse. It is hands-on, with 50% travel to Reading, Perth or Glasgow, and a permanent, full-time,