Senior Data Engineer

Airswift; Greater London; Remoto; GBP 70.000 - 110.000; Tempo pieno

Descrizione del lavoro

Airswift is seeking a Senior Data Engineer in London with responsibility for owning the data pipeline architecture, orchestration, and production readiness in a highly technical data environment.

The role focuses on building robust data workflows using Databricks, SQL, Python, and Spark, while ensuring strong observability, validation, and production support. This 12-month contract suits professionals who drive data quality and end-to-end delivery.

Competenze

• Must own data pipeline architecture, orchestration, and production readiness.
• Experience with arbitration, eligibility, suppression, consent, policy logic flows.
• Experience managing activation datasets, manifests, delivery status, and file transfers.
• Experience sequencing PRs and end-to-end validation including regression testing.
• Support production cutover, rerun, recovery activities, observability and incident response.

Mansioni

• Own data pipeline architecture, orchestration, and production readiness.
• Lead end-to-end validation, regression testing, and production support.
• Ensure observability, alerts, and incident response for data workflows.

Conoscenze

SQL (Advanced)

Python/Spark

Databricks

Workflow orchestration

Idempotent design

CI/CD

Pull request review

Data quality controls

Strumenti

Databricks

Azure DevOps

Git

Descrizione del lavoro

Job Title: Senior Data Engineer

Duration: 12 months

Schedule: 40 hrs/week

Location: London, United Kingdom (Remote)

This opportunity offers the chance to take ownership of pipeline architecture, orchestration, and production readiness within a highly technical data engineering environment. The role focuses on building and supporting robust data workflows using Databricks, SQL, Python, and Spark, while ensuring strong observability, validation, and production support. This position will suit professionals who enjoy driving data quality, workflow reliability, and end-to-end delivery in a complex activation and decisioning landscape.

Required Experience

• Experience owning data pipeline architecture, orchestration, and production readiness in a data engineering environment
• Experience implementing and reviewing logic related to arbitration, eligibility, suppression, consent, contact policy, and cooldown processes
• Experience managing activation datasets, files, manifests, delivery status, and file transfer integrations
• Experience sequencing and approving pull requests, with responsibility for end-to-end, regression, and production validation
• Experience supporting production cutover, rerun and recovery activities, observability, alerting, and incident response

Required Skills

• Advanced SQL
• Python and Spark data engineering
• Databricks
• Workflow orchestration and dependency management
• Idempotency and scheduled or triggered job design
• CI/CD, Git, and Azure DevOps
• Pull request review, unit testing, integration testing, and environment promotion
• Data quality controls, alerting, reconciliation, and incident diagnosis

Preferred Qualifications

• CRM decisioning experience
• Customer eligibility, consent, and activation experience
• Practical Comarch experience
• Practical SFMC and SFTP interface experience

About Airswift

Airswift is an international workforce solutions provider within the energy, process and infrastructure industries. Airswift serves as a strategic partner to clients, offering a turnkey workforce solution to capture and deliver the top talent needed to complete successful projects by aligning with unique project needs. With over 1000 employees and 9,000 contractors operating in over 60 countries, Airswift's geographical reach and pool of talent available is unmatched in the industry.