Senior Data Engineer — Remote Pipelines (Python, PySpark, Fabric)

CreateFuture; City of Edinburgh; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

CreateFuture, an AI-native consulting partner, is seeking a Senior Data Engineer to own the design, delivery, and reliability of production data pipelines built on Microsoft Fabric, Python, and PySpark. You’ll mentor junior engineers and raise engineering practice across client engagements.

You’ll collaborate with architects, product teams, and client stakeholders to translate data requirements into robust, maintainable solutions, while enjoying flexible hybrid/remote options and offices across

Qualifications

• Strong SQL skills and data modelling experience.
• Proficiency in Python and PySpark for batch data processing.
• Experience with modern cloud data platforms.
• Experience owning delivery of data engineering work with limited oversight.

Responsibilities

• Take ownership of designing, building, and maintaining scalable, production-ready data pipelines using Microsoft Fabric, Python, and PySpark.
• Make sound technical decisions on pipeline architecture, data modelling, and tooling.
• Mentor and support junior engineers, reviewing code and raising delivery standards.
• Own and improve CI/CD pipelines for data workflows and deployments.
• Troubleshoot and resolve complex issues in live data pipelines.
• Collaborate with cross-functional teams and client stakeholders to translate data requirements into technical solutions.

Job description

CreateFuture, an AI-native consulting partner, is seeking a Senior Data Engineer to own the design, delivery, and reliability of production data pipelines built on Microsoft Fabric, Python, and PySpark. You’ll mentor junior engineers and raise engineering practice across client engagements.

You’ll collaborate with architects, product teams, and client stakeholders to translate data requirements into robust, maintainable solutions, while enjoying flexible hybrid/remote options and offices across