Senior Data Engineer – Modern Lakehouse, Azure & AI Impact

SF Partners; St Helens; Hybrid; GBP 70,000 - 80,000; Full time

Job summary

SF Partners is recruiting a hands-on Senior Data Engineer in the UK to advance a modern data capability built on Python/PySpark, Fabric, and Azure. You will contribute to lakehouse/medallion style designs, with a focus on code-led development and AI-ready data solutions.

You'll influence architecture, coding standards, CI/CD, testing, and best practices while remaining deeply technical and hands-on. The role offers 1–2 days per week in the North West and potential flexibility for exceptional

Qualifications

• Hands-on data engineering experience at Senior level.
• Experience with modern data platforms and cloud native architectures.
• Strong coding standards, testing, and CI/CD practices.

Responsibilities

• Lead design and implementation of data pipelines and models.
• Influence architecture, coding standards, and best practices across the team.
• Create reusable engineering patterns and ensure data quality and observability.
• Collaborate with cross-functional teams to deliver a modern data capability.

Skills

Python

PySpark

Fabric

Spark

Delta

SQL

Azure

Git

CI/CD

Data quality

Job description

SF Partners is recruiting a hands-on Senior Data Engineer in the UK to advance a modern data capability built on Python/PySpark, Fabric, and Azure. You will contribute to lakehouse/medallion style designs, with a focus on code-led development and AI-ready data solutions.

You'll influence architecture, coding standards, CI/CD, testing, and best practices while remaining deeply technical and hands-on. The role offers 1–2 days per week in the North West and potential flexibility for exceptional