Data Engineering Lead - Cloud Data Lake & AI Solutions

FSP; Reading; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

FSP is seeking a Lead Data Engineer to drive enterprise-scale data solutions across cloud platforms. You will lead the data engineering team, shape architectural decisions, and deliver high-quality data products that enable automated decision making.

You will work closely with architects and consultants in a hybrid environment, leveraging Azure Databricks, Microsoft Fabric, and SQL/Python to build scalable data pipelines and governance controls.

Qualifications

• Extensive experience designing enterprise-scale data engineering solutions.
• Hands-on Azure Databricks and PySpark across cloud platforms.
• Strong background with Python and SQL development.
• Experience with batch and streaming data pipelines and lakehouse patterns.
• Knowledge of data modelling (dimensional/star/dv) and governance.

Responsibilities

• Lead technical design and architecture discussions for data platforms.
• Mentor and coach the data engineering team across projects.
• Act as technical lead across multiple projects and teams.
• Translate customer requirements into scalable data solutions.
• Develop cloud-native data products and data lake patterns.
• Provide guidance through prototyping, testing, build and launch.
• Contribute to design docs and development standards.

Skills

Azure Databricks

PySpark

Delta Live Tables

Databricks Workflows

Microsoft Fabric

Azure Data Platform

Python

SQL

Batch & Streaming Pipelines

Medallion Architecture

Lakehouse Patterns

Data Modelling (Dimensional, Star, DV)

CI/CD

Infrastructure as Code

DevOps Practices

Git-Based Source Control

Data Governance & Security

Tools

Power BI

Git

Terraform

Job description

FSP is seeking a Lead Data Engineer to drive enterprise-scale data solutions across cloud platforms. You will lead the data engineering team, shape architectural decisions, and deliver high-quality data products that enable automated decision making.

You will work closely with architects and consultants in a hybrid environment, leveraging Azure Databricks, Microsoft Fabric, and SQL/Python to build scalable data pipelines and governance controls.