Senior CDI Data Engineer - Golden Layer & Databricks Lead

Airswift; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

Airswift is seeking a CDI Sr Data Engineer for a 12-month remote role in the United Kingdom. You will own the Golden Layer data domain, focusing on Databricks, SQL, Python/Spark, and dimensional modelling to support analytics consumers.

You will define technical standards, manage data quality and lineage, and optimize workflows for high-volume transaction processing in a remote setup connected to Canary Wharf. Collaboration across teams is essential for scalable data products.

Qualifications

• This role requires ownership of Golden Layer facts and dimensions, including customer, identifier, consent, transaction, redemption, and feedback models.
• Experience with source-to-target mapping, SCD history handling, CDC, and historical backfill.
• Experience resolving cross-system data quality issues and historical reload challenges.
• Experience supporting orchestration, CI/CD, testing, observability, and production environments.
• Experience with high-volume transaction processing and performance optimisation.

Responsibilities

• Own the Golden Layer data domain and ensure data quality, lineage, and interface contracts for downstream consumers.
• Lead data modeling, scheduling workflows, and runtime optimisation to support analytics consumers.
• Collaborate to define technical standards and scalable data products.

Skills

SQL

Python

Spark

Databricks

Dimensional modelling

SCD1/SCD2

Workflow scheduling

Data lineage

Data quality

Interface contracts

Tools

Databricks

Job description

Airswift is seeking a CDI Sr Data Engineer for a 12-month remote role in the United Kingdom. You will own the Golden Layer data domain, focusing on Databricks, SQL, Python/Spark, and dimensional modelling to support analytics consumers.

You will define technical standards, manage data quality and lineage, and optimize workflows for high-volume transaction processing in a remote setup connected to Canary Wharf. Collaboration across teams is essential for scalable data products.