CDI Sr Data Engineer

Airswift; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

Airswift is seeking a CDI Sr Data Engineer for a 12-month remote role in the United Kingdom. You will own the Golden Layer data domain, focusing on Databricks, SQL, Python/Spark, and dimensional modelling to support analytics consumers.

You will define technical standards, manage data quality and lineage, and optimize workflows for high-volume transaction processing in a remote setup connected to Canary Wharf. Collaboration across teams is essential for scalable data products.

Qualifications

• This role requires ownership of Golden Layer facts and dimensions, including customer, identifier, consent, transaction, redemption, and feedback models.
• Experience with source-to-target mapping, SCD history handling, CDC, and historical backfill.
• Experience resolving cross-system data quality issues and historical reload challenges.
• Experience supporting orchestration, CI/CD, testing, observability, and production environments.
• Experience with high-volume transaction processing and performance optimisation.

Responsibilities

• Own the Golden Layer data domain and ensure data quality, lineage, and interface contracts for downstream consumers.
• Lead data modeling, scheduling workflows, and runtime optimisation to support analytics consumers.
• Collaborate to define technical standards and scalable data products.

Skills

SQL

Python

Spark

Databricks

Dimensional modelling

SCD1/SCD2

Workflow scheduling

Data lineage

Data quality

Interface contracts

Tools

Databricks

Job description

Job Title: CDI Sr Data Engineer Duration: 12-months Schedule: 40 hrs/week Location: United Kingdom (Remote)

This opportunity offers the chance to take ownership of a customer-focused Golden Layer data domain within a remote working environment connected to Canary Wharf. The role is centred on Databricks, SQL, Python/Spark, dimensional modelling, and high-volume transaction processing, with responsibility for data quality, lineage, workflow scheduling, and runtime optimisation. This position will play an important part in shaping scalable data products and supporting analytics consumers through well-defined technical standards and interface contracts.

Required Experience:

• Experience owning Golden Layer facts and dimensions, including customer, identifier, consent, transaction, redemption, and feedback models
• Experience with source-to-target mapping, SCD history handling, CDC, and historical backfill
• Experience resolving cross-system data quality issues and historical reload challenges
• Experience supporting orchestration, CI/CD, testing, observability, and production environments
• Experience working with high-volume transaction processing and performance optimisation

Required Skills:

• Expert SQL
• Strong Python and Spark capability
• Strong Databricks expertise
• Dimensional modelling and data product modelling
• SCD1 and SCD2 design and implementation
• Workflow scheduling, trigger dependency management, and freshness monitoring
• Data lineage, data quality management, and technical documentation
• Ability to define technical standards and interface contracts for downstream consumers

Preferred Qualifications:

• Experience in CRM, loyalty, consent, and customer identity domains
• Exposure to CIS, Comarch, SFMC, AWS/Data Hub, and analytics consumer environments

About Airswift:

Airswift is an international workforce solutions provider within the energy, process and infrastructure industries. Airswift serves as a strategic partner to clients, offering a turnkey workforce solution to capture and deliver the top talent needed to complete successful projects by aligning with unique project needs. With over 1000 employees and 9,000 contractors operating in over 60 countries, Airswift's geographical reach and pool of talent available is unmatched in the industry.