Senior Data Engineer

Bright Purple; Bedford; Hybrid; GBP 78,000 - 88,000; Full time

Job summary

Bright Purple is recruiting an experienced Senior Data Engineer to join a major digital transformation programme, supporting the migration and integration of data into a new, business-critical digital platform. This is a hands-on contract opportunity requiring strong Python, SQL and Azure experience.

You will develop data migration and integration solutions, build data pipelines, optimise SQL queries, and ensure data quality across systems, APIs and Azure storage.

Qualifications

• Hands-on data migration and integration experience.
• Proficient in Python and SQL for ETL and transformation.
• Experience with Microsoft Azure and Azure SQL.
• Familiarity with APIs and data validation processes.

Responsibilities

• Develop and deliver data migration and integration solutions across multiple systems.
• Extract, transform and load data from legacy applications into a modern cloud-based platform.
• Develop and optimise complex SQL queries, scripts and transformation processes.
• Build and maintain reliable data pipelines using Python and Azure SQL.
• Identify and resolve data quality, integrity and consistency issues.
• Implement data validation, reconciliation and error-handling processes.
• Support system-to-system integrations, including APIs.

Skills

Python

SQL

Azure

ETL

Data migration

APIs

CI/CD

Tools

Azure SQL

Parquet

Azure DevOps

DuckDB

DACPAC

Job description

£425 - £475 | Outside IR35 | Bedfordshire | Hybrid (2 days onsite)

Bright Purple is recruiting an experienced Senior Data Engineer to join a major digital transformation programme, supporting the migration and integration of data into a new, business-critical digital platform. This is a hands-on contract opportunity requiring strong Python, SQL and Azure experience. You'll work closely with engineering and data teams to deliver reliable data migration, transformation and integration solutions.

Role Overview:

• Develop and deliver data migration and integration solutions across multiple systems.
• Extract, transform and load data from legacy applications into a modern cloud-based platform.
• Develop and optimise complex SQL queries, scripts and transformation processes.
• Build and maintain reliable data pipelines using Python and Azure SQL.
• Identify and resolve data quality, integrity and consistency issues.
• Implement data validation, reconciliation and error-handling processes.
• Support system-to-system integrations, including APIs.
• Python and T-SQL expertise, including data transformation and performance optimisation.
• Hands-on experience with Microsoft Azure and Azure SQL.
• Strong understanding of ETL processes, data mapping, validation and reconciliation.
• Experience integrating data across multiple applications and data sources
• Knowledge of Azure DevOps, repositories and CI/CD pipelines.
• Azure Blob Storage, Parquet, DuckDB and bulk data loading.
• SSDT / DACPAC.
• Experience migrating legacy systems into modern cloud platforms.
• Experience with containerisation and API-based integrations.
• Familiarity with AI coding tools such as Claude Code.

This is an excellent opportunity for a technically strong Data Engineer who enjoys solving complex data challenges and delivering practical solutions without unnecessary complexity.

Bright Purple is an equal opportunities employer. We welcome applications from candidates of all backgrounds and are committed to promoting diversity and inclusion throughout the recruitment process.