Data Engineer

SSE PLC; Reading, Perth, Glasgow; On-site; GBP 36,000 - 54,000; Full time

Benefits offered by this job

Private healthcare discounts

Gym discounts

Online GP

Counselling service

Cycle to Work

Tech/Transport loans

Maternity & Adoption pay

Paternity leave

Job summary

SSE is seeking a Data Engineer to design, develop and optimise ELT/ETL pipelines across Azure Databricks, Delta Lake and Databricks SQL. You will model data for analytics and collaborate with data architects, analysts and product teams to deliver reliable data products.

The role sits in the Data & AI team, delivering the Renewables Data Platform on Databricks and migrating solutions from Synapse. It is hands-on, with 50% travel to Reading, Perth or Glasgow, and a permanent, full-time,

Qualifications

• Experience delivering data solutions in a growing business environment with varied data needs.
• Strong communication skills with both technical and non-technical stakeholders.
• Proactive and adaptable mindset with willingness to learn and grow.
• Proven data engineering experience building batch/streaming pipelines with Databricks.
• Technical capability in Python, PySpark and SQL for transformations and BI data models.

Responsibilities

• Build and maintain metadata-driven pipelines using Azure Databricks to ingest and transform data.
• Develop Delta Lake layers (bronze/silver/gold) and BI-ready data models with Power BI.
• Use Databricks pipelines, jobs, notebooks, PySpark and SQL for large-scale transformations.
• Support governance, security, and data contracts with Unity Catalog and permissions.
• Collaborate with DevOps and product teams to enable CI/CD and continuous skill growth.

Skills

Data pipeline development

Stakeholder communication

Analytical thinking

Tools

Azure Databricks

Delta Lake

Databricks SQL

PySpark

Python

SQL

Power BI

Job description

Base Location: You'll be expected to spend 50% of your working week in one of the following locations: Reading, Perth or Glasgow

Salary: £36,200- £54,400 + Performance-related bonus and a range of benefits to support your finances, wellbeing and family.

Working Pattern: Permanent | Full Time | Flexible First options available

The Role

As a Data Engineer, you will focus on designing, developing, and optimising data ingestion, transformation, and serving layers across Azure Databricks, Delta Lake, and Databricks SQL. Your work will enable reliable data products and insights for stakeholders, and you'll collaborate with data architects, analysts, and product teams to deliver robust ELT/ETL pipelines, model data for performance and usability, and apply best practices in security and data quality.

Working within the Data & AI team, you will contribute to developing our new Renewables Data Platform on Databricks and migrating existing data solutions from Synapse. This role is hands-on and collaborative, combining pipeline development, data modelling, and quality and security practices to deliver well-structured, reliable data solutions aligned with business needs.

You Will

• Build and maintain metadata-driven pipelines using Azure Databricks to ingest and transform batch and streaming data, ensuring data quality and scalable processing.


• Develop Delta Lake layers following bronze/silver/gold patterns, and model data optimised for BI and analytics, including Power BI integration through Databricks SQL.


• Use Databricks pipelines, jobs, notebooks, PySpark and SQL to perform large-scale transformations and implement data quality, monitoring and performance best practices


• Support Governance, Security & Compliance through Unity Catalog lineage, cataloguing and code-managed permissions, applying data protection controls and contributing to SLAs, SLOs and data contracts.


• Collaborate across DevOps and product teams to refine requirements, deliver version-controlled solutions through CI/CD, and continuously develop your skills with evolving tools and technologies.

You Have

• Experience delivering data solutions in a growing business environment with varied data needs, and the ability to manage and prioritise workload effectively.


• Strong communication skills, able to engage clearly with technical and non-technical stakeholders across the IM Apps & Data team and wider business.


• Adaptability and a proactive mindset, with a willingness to learn, develop, and approach challenges with a positive attitude.


• Proven data engineering experience, including building metadata-driven batch and streaming pipelines using Azure Databricks, and developing Delta Lake architectures using bronze/silver/gold patterns.


• Technical capability in large-scale data processing, including Python, PySpark and SQL for transformations and data quality, and designing performant BI/analytics data models with Power BI integration.

About SSE

SSE has a bold ambition - to be a leading energy company in a net zero world. We're building the world's largest offshore wind farm. Transforming the grid to provide greener electricity for millions of people and investing over £20 billion in homegrown energy, with £20 billion more in the pipeline.

Our IT division powers growth across all SSE business areas by making sure we have the systems, software and security needed to take the lead in a low carbon world. They provide expertise, advice and day-to-day support in emerging technologies, data and analytics, cyber security and more.

Flexible benefits to fit your life

Enjoy discounts on private healthcare and gym memberships. Wellbeing benefits like a free online GP and 24/7 counselling service. Interest-free loans on tech and transport season tickets, or a new bike with our Cycle to Work scheme. As well as generous family entitlements such as maternity and adoption pay, and paternity leave.

Work with an equal opportunity employer

SSE will make any reasonable adjustments you need to ensure that your application and experience with us is positive. Please contact [e-mail] / 01738275 846 to discuss how we can support you.

We're dedicated to fostering an open and inclusive workplace where people from all backgrounds can thrive. We create equal opportunities for everyone to succeed and especially welcome applications from those who may not be well represented in our workforce or industry.