Senior Data Engineer: Pipelines & Production Readiness

Airswift; Greater London; Remoto; GBP 70.000 - 110.000; Tempo integral

Resumo da vaga

Airswift is seeking a Senior Data Engineer in London with responsibility for owning the data pipeline architecture, orchestration, and production readiness in a highly technical data environment.

The role focuses on building robust data workflows using Databricks, SQL, Python, and Spark, while ensuring strong observability, validation, and production support. This 12-month contract suits professionals who drive data quality and end-to-end delivery.

Qualificações

• Must own data pipeline architecture, orchestration, and production readiness.
• Experience with arbitration, eligibility, suppression, consent, policy logic flows.
• Experience managing activation datasets, manifests, delivery status, and file transfers.
• Experience sequencing PRs and end-to-end validation including regression testing.
• Support production cutover, rerun, recovery activities, observability and incident response.

Responsabilidades

• Own data pipeline architecture, orchestration, and production readiness.
• Lead end-to-end validation, regression testing, and production support.
• Ensure observability, alerts, and incident response for data workflows.

Conhecimentos

SQL (Advanced)

Python/Spark

Databricks

Workflow orchestration

Idempotent design

CI/CD

Pull request review

Data quality controls

Ferramentas

Databricks

Azure DevOps

Git

Descrição da vaga

Airswift is seeking a Senior Data Engineer in London with responsibility for owning the data pipeline architecture, orchestration, and production readiness in a highly technical data environment.

The role focuses on building robust data workflows using Databricks, SQL, Python, and Spark, while ensuring strong observability, validation, and production support. This 12-month contract suits professionals who drive data quality and end-to-end delivery.