Data Engineer - Python/PySpark on Fabric

SF Partners; Liverpool City Region; Hybrid; GBP 55,000 - 65,000; Full time

Benefits offered by this job

Benefits

Job summary

SF Partners is seeking a Data Engineer to help shape its modern data platform in St Helens, with a hybrid model requiring 1–2 days on site. The role focuses on Python, PySpark and Microsoft Fabric to build pipelines and data products on top of a growing Fabric/Azure environment.

You’ll contribute to a team moving away from traditional SQL-based tooling, embracing a code-first approach, notebook development, and distributed processing. A flexible benefits package is offered.

Qualifications

• Strong experience with Python, PySpark and data engineering.
• Experience with modern data platforms and Fabric/Azure is a plus.
• Production-grade data solutions through code and distributed processing.

Responsibilities

• Develop pipelines, transformations and data products on the new Fabric platform.
• Adopt a code-led approach with Python and PySpark in production.
• Collaborate with CI/CD, Git and notebook-based development workflows.
• Ensure data quality, monitoring and governance across the data estate.

Skills

Python

PySpark

Microsoft Fabric

Azure

SQL

Databricks

Notebook development

Git

CI/CD

Tools

Git

CI/CD pipelines

Delta tables

Job description

SF Partners is seeking a Data Engineer to help shape its modern data platform in St Helens, with a hybrid model requiring 1–2 days on site. The role focuses on Python, PySpark and Microsoft Fabric to build pipelines and data products on top of a growing Fabric/Azure environment.

You’ll contribute to a team moving away from traditional SQL-based tooling, embracing a code-first approach, notebook development, and distributed processing. A flexible benefits package is offered.