Data Engineer: Fabric & Pipelines (Hybrid, Edinburgh)

Bright Purple; City of Edinburgh; Hybrid; GBP 74,000 - 88,000; Full time

Job summary

Bright Purple is seeking an experienced Data Engineer in Edinburgh to join a major data transformation programme. You will work hands-on through the migration from a legacy warehouse to a Microsoft Fabric environment, testing outputs, debugging data differences, and implementing remedial changes for production readiness.

Post go-live, you will develop data pipelines and support reporting needs across the business, leveraging PySpark, SQL, and Power BI where applicable, with hybrid working in

Qualifications

• Experience in migrating or modernising data warehouses.
• Strong PySpark and SQL skills.
• Experience building data pipelines and validating data quality.

Responsibilities

• Support final migration to Microsoft Fabric in production.
• Develop data pipelines and monitor data quality across environments.
• Provide go-live support and post-go-live enhancements for data & reporting.
• Collaborate with BI/reporting teams to deliver data requirements.

Skills

Microsoft Fabric

PySpark

SQL

Data pipelines

Data testing

Validation

Debugging

Power BI

Job description

Bright Purple is seeking an experienced Data Engineer in Edinburgh to join a major data transformation programme. You will work hands-on through the migration from a legacy warehouse to a Microsoft Fabric environment, testing outputs, debugging data differences, and implementing remedial changes for production readiness.

Post go-live, you will develop data pipelines and support reporting needs across the business, leveraging PySpark, SQL, and Power BI where applicable, with hybrid working in