Data Engineer

Bright Purple; City of Edinburgh; On-site; GBP 74,000 - 88,000; Full time

Job summary

Bright Purple is recruiting an experienced Data Engineer for Edinburgh on a contract basis to work on a data transformation programme moving to Microsoft Fabric. The role focuses on final migration tasks, data validation and debugging, with transition into post go-live data pipeline development and reporting support.

The candidate will bring strong Fabric exposure, Synapse, PySpark and SQL skills, plus experience in data pipelines and migrations. Hybrid Edinburgh working is offered.

Qualifications

• Fabric experience on real-world project required.
• Strong Synapse development experience.
• Excellent PySpark and SQL skills.
• Experience building and developing data pipelines.
• Strong data testing, validation and debugging skills.
• Experience migrating or modernising data warehouses.
• Power BI experience is a bonus.

Responsibilities

• Support final stages of migration from legacy DW to Fabric environment.
• Test outputs and identify/debug data differences.
• Make remedial changes to prepare production readiness.
• Post go-live support and continued development of data pipelines.
• Help deliver data and reporting needs across the business.

Skills

Microsoft Fabric

Microsoft Synapse

PySpark

SQL

Data pipelines

Data testing

Data migration

Power BI

Job description

Data Engineer, Microsoft Fabric

£400 to £475 per day, Inside IR35
Edinburgh, Hybrid

Bright Purple are looking for an experienced Data Engineer to join a major data transformation programme in Edinburgh.

This is a hands on contract role, joining at an important point in the transition from a legacy data warehouse to a new Microsoft Fabric environment.

With go live approaching, your initial focus will be on the final stages of the migration, testing outputs, identifying and debugging differences in data, and making the remedial changes required to get the new environment ready for production. Once live, you will move into post go live support and continued development, building data pipelines and helping deliver the data and reporting requirements across the business.

What we're looking for:

• Microsoft Fabric experience is a must have. You don't need years of experience, but you must have used Fabric on at least one real world commercial project
• Strong, demonstrable Microsoft Synapse development experience
• Excellent PySpark and SQL skills
• Experience building and developing data pipelines
• Strong data testing, validation and debugging skills
• Experience working across data warehouse migrations or modernisation projects
• Power BI experience would be beneficial

The key here is the combination of strong core Microsoft data engineering experience with genuine exposure to Fabric. We're not looking for a Fabric specialist, but equally, training or self learning alone won't be enough.

This is an initial contract offering £400 to £475 per day, Inside IR35, with hybrid working in Edinburgh.