Senior Data Engineer — Databricks & Delta Lake Architect

FPSG; Glasgow; On-site; GBP 65,000 - 90,000; Full time

Job summary

FPSG is seeking a Senior Data Engineer to own and optimize a Databricks-based data platform. You will write pipeline code, build jobs, and model data as a core daily task, shaping the data layer for Fabric/OneLake.

You will design, deploy, and maintain pipelines, ensure robust data architectures, and apply Delta Lake patterns with a strong emphasis on SQL and Python/Scala for pipeline logic.

Qualifications

• Hands-on experience building and running Databricks Pipelines/Jobs.
• Strong data modelling ability from raw data to silver/gold tables.
• Solid Delta Lake knowledge including time travel and optimization.
• Experience with Databricks Asset Bundles or equivalent deployment/CI practices.
• Practical experience building environment-variable-driven Azure Data Factory pipelines.

Responsibilities

• Design, build, and operate Databricks Pipelines and Jobs.
• Design and build Delta Lake pipelines.
• Own Databricks deployment bundles, packaging, versioning, and promotion of pipelines.
• Build data pipelines using environment-variable-driven Azure Data Factory pipelines.
• Contribute to the data layer feeding Microsoft Fabric/OneLake.

Skills

Databricks pipelines

Delta Lake

Azure Data Factory

SQL

Python/Scala

Data modelling

Data architecture

CI/CD pipelines

Tools

Databricks Asset Bundles

Job description

FPSG is seeking a Senior Data Engineer to own and optimize a Databricks-based data platform. You will write pipeline code, build jobs, and model data as a core daily task, shaping the data layer for Fabric/OneLake.

You will design, deploy, and maintain pipelines, ensure robust data architectures, and apply Delta Lake patterns with a strong emphasis on SQL and Python/Scala for pipeline logic.