Senior Data Engineer - Cloud Lakehouse Lead & Mentor

FSP; Reading; Hybrid; GBP 65,000 - 100,000; Full time

Benefits offered by this job

Hybrid working

Competitive salary

Coaching and mentoring

Job summary

FSP, a leading Data & AI consultancy, seeks a Senior Data Engineer to join our growing Data & AI function. You will work with architects and consultants to deliver cloud-based data solutions that enable automated decision making and scalable insights for clients.

Typical responsibilities include leading design discussions, mentoring engineers, and delivering enterprise-scale data pipelines across Azure and cloud-native platforms.

Qualifications

• Extensive experience designing and delivering enterprise-scale data engineering solutions.
• Practical Microsoft Fabric experience, including Lakehouse, Data Factory, Warehouse and Spark.
• Strong hands-on experience with Azure Databricks, including PySpark, Delta Live Tables and Databricks Workflows and orchestration.
• Knowledge of Azure Data Platform services, including ADF, ADLS Gen2, Azure Synapse Analytics.
• A strong background in Python and SQL development.
• Proven experience building batch and streaming data pipelines.
• Experience implementing Medallion Architecture and Lakehouse patterns.
• Strong understanding of data modelling techniques (dimensional, star schema, data vault).
• Experience with CI/CD, Infrastructure as Code and DevOps practices, Git-based source control and deployment pipelines.
• Strong understanding of data governance, security, and access control.

Responsibilities

• You will work as key member of our Data Engineering team, using your proven experience as required, mentoring others within the team.
• lead technical design and architecture discussions and mentor team members.
• Operating as a technical lead across multiple projects and teams.
• Understand customer requirements and work collaboratively to design data solutions that deliver high-quality outcomes.
• Enable higher quality data to be created & managed in our customers organisations.
• Develop high-quality data products utilising (primarily) cloud native patterns.
• Engineer cloud-based data lake patterns to connect and leverage organisational & external data.
• Provide technical support and guidance through prototyping, testing, build, and launch of data products.
• Contribute towards the creation of technical support and design documentation for data platforms and solutions.
• Contribute to continually refining our development standards and best practices.

Skills

Microsoft Fabric

Lakehouse

Data Factory

Azure Synapse

Databricks

PySpark

Delta Live Tables

Databricks Workflows

Python

SQL

Batch pipelines

Streaming pipelines

Medallion Architecture

Data modelling

CI/CD

IaC

DevOps

Git

Data governance

Security

Power BI

SQL Server

SSIS

Tools

Power BI

SQL Server

SSIS

Job description

FSP, a leading Data & AI consultancy, seeks a Senior Data Engineer to join our growing Data & AI function. You will work with architects and consultants to deliver cloud-based data solutions that enable automated decision making and scalable insights for clients.

Typical responsibilities include leading design discussions, mentoring engineers, and delivering enterprise-scale data pipelines across Azure and cloud-native platforms.