Senior Data Engineer

Recruit with Purpose; Newcastle upon Tyne; Hybrid; GBP 54,000 - 66,000; Full time

Job summary

Recruit with Purpose is seeking a Senior Data Engineer to design a brand-new Microsoft Fabric environment and steer a data transformation journey. You'll shape foundations, standards and capabilities from the ground up, not merely maintain an existing platform.

You'll lead architectural direction, stay hands-on, and work with stakeholders to deliver scalable ETL/ELT pipelines, lakehouse structures and modern data architectures, with CI/CD and Azure DevOps guiding the build.

Qualifications

• Experience designing and building data pipelines (ETL/ELT) for large-scale environments.
• Knowledge of modern data architectures, lakehouse patterns and medallion architecture.
• Hands-on experience with CI/CD, testing, automation and deployment practices.

Responsibilities

• Designing, developing and optimising data pipelines and integrations.
• Help to build and evolve a new Microsoft Fabric platform.
• Creating lakehouse structures and implementing modern data architecture principles.
• Championing CI/CD, testing, automation and deployment best practices.
• Support migration from legacy solutions to a cloud-first environment.
• Collaborate with stakeholders to understand requirements and deliver high-quality solutions.
• Coach and support other engineers within the team.
• Act as technical lead for complex engineering challenges.

Skills

Strong SQL skills

Experience with PySpark

Cloud data architecture knowledge

Tools

Microsoft Fabric

Azure DevOps

Job description

Are you a Senior Data Engineer looking for the chance to shape a brand-new Microsoft Fabric environment rather than simply maintain an existing one?

This Housing Association is at the beginning of an exciting data transformation journey and is investing significantly in modernising its data estate. With Microsoft Fabric at the heart of the strategy, they're now looking for a Senior Data Engineer to help design and build the platform that will support data-driven decision making across the organisation.

This isn't a role where you'll inherit a mature platform and spend your days making incremental changes. Instead, you'll play a leading role in creating the foundations, engineering standards, and technical capabilities that will define the future of data within the business.

As Senior Data Engineer, you'll take architectural direction and turn it into robust, scalable engineering solutions, while remaining hands‑on throughout the build.

In this role, you'll be:

• Designing, developing and optimising data pipelines and integrations
• Helping to build and evolve a new Microsoft Fabric platform
• Creating lakehouse structures and implementing modern data architecture principles
• Championing best practice around CI/CD, testing, automation and deployment
• Supporting the migration from legacy solutions into a cloud-first environment
• Working closely with stakeholders to understand requirements and deliver high-quality solutions
• Coaching and supporting other engineers within the team
• Acting as the technical lead for complex engineering challenges

This is a genuine opportunity to influence how data engineering is approached across the organisation. You'll have a voice in technical decisions, platform design, tooling choices, and engineering standards from the outset.

If you enjoy solving complex problems, building things properly, and leaving a lasting impact, this role offers plenty of scope to grow and progress.

We'd love to speak with you if you have:

• Experience working with modern Microsoft data technologies (Microsoft Fabric experience would be ideal, although Azure experience is highly transferable)
• Proven experience designing and building ETL/ELT data pipelines
• Strong SQL skills alongside experience with PySpark or similar technologies
• An understanding of modern data architectures, including lakehouse and medallion patterns
• Experience working with CI/CD pipelines and Azure DevOps
• A solid grasp of data modelling, data quality, and governance principles

The salary for this role is £60,000 and you will need to be able to work in a hybrid way with one day a week at the offices near Newcastle.