Data Engineer – Azure Databricks & Delta Lake (Hybrid)

Sse Enterprise; Glasgow; Hybrid; GBP 36,000 - 54,000; Full time

Benefits offered by this job

Private healthcare

Cycle to Work scheme

Wellbeing programme

Job summary

SSE Enterprise seeks a Data Engineer to design, build and optimise data ingestion, transformation and serving layers across Azure Databricks, Delta Lake and Databricks SQL. You will help deliver reliable data products and insights for stakeholders while working with data architects, analysts and product teams to create robust ELT/ETL pipelines.

Within the Data & AI team, you will model data for performance and usability, implement data quality controls and contribute to security practices,

Qualifications

• Experience delivering data solutions in a growing business environment with varied data needs.
• Strong communication skills to engage with technical and non-technical stakeholders.
• Proven data engineering experience with Azure Databricks, Delta Lake architectures (bronze/silver/gold).

Responsibilities

• Build and maintain metadata-driven pipelines using Azure Databricks for batch and streaming data.
• Develop Delta Lake layers following bronze/silver/gold patterns for BI/analytics.
• Use Databricks pipelines, jobs, notebooks, PySpark and SQL for large-scale transformations and data quality.
• Support governance, security, compliance through Unity Catalog and data contracts.
• Collaborate with DevOps and product teams to deliver CI/CD‑driven solutions.

Skills

Azure Databricks

PySpark

SQL

Power BI

Data modelling

Tools

Delta Lake

Databricks SQL

Job description

SSE Enterprise seeks a Data Engineer to design, build and optimise data ingestion, transformation and serving layers across Azure Databricks, Delta Lake and Databricks SQL. You will help deliver reliable data products and insights for stakeholders while working with data architects, analysts and product teams to create robust ELT/ETL pipelines.

Within the Data & AI team, you will model data for performance and usability, implement data quality controls and contribute to security practices,