Data Engineer: Lakehouse Pipelines & Real-Time Analytics

SLAMcore; United Kingdom; On-site; GBP 70,000 - 110,000; Full time

Job summary

SLAMcore in the United Kingdom is seeking a Data Engineer to build and maintain robust data pipelines for enterprise analytics. You will develop efficient ETL/ELT workflows using Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data.

You will work with PySpark, Databricks SQL, T-SQL, and Delta Lake formats, implementing data quality checks, governance, and CI/CD pipelines to support real-time Power BI Direct Lake reporting.

Qualifications

• Experience building production ETL/ELT pipelines.
• Strong knowledge of Delta Lake formats and data lakehouse concepts.
• Experience with Databricks and Fabric platforms.

Responsibilities

• Build and maintain robust data pipelines for analytics.
• Optimise ETL/ELT workflows using Databricks and Fabric.
• Implement data quality checks and monitoring.
• Configure data access governance via Unity Catalog.
• Prepare data for real-time Power BI Direct Lake reporting.

Skills

PySpark

Databricks SQL

T-SQL

Delta Lake formats

Databricks Workspaces

Fabric Data Factory

Delta Live Tables

Medallion Architecture

Data quality checks

Data orchestration

Git CI/CD

Power BI Direct Lake

Unity Catalog governance

Tools

Databricks

Microsoft Fabric

Git

Databricks Asset Bundles

Job description

SLAMcore in the United Kingdom is seeking a Data Engineer to build and maintain robust data pipelines for enterprise analytics. You will develop efficient ETL/ELT workflows using Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data.

You will work with PySpark, Databricks SQL, T-SQL, and Delta Lake formats, implementing data quality checks, governance, and CI/CD pipelines to support real-time Power BI Direct Lake reporting.