Senior Data Engineer

Retelligence; Greater London; Hybrid; GBP 110,700 - 147,600; Full time

Job summary

Retelligence in London is seeking a Senior Data Engineer for a high-impact modernization of a core data platform. This Outside IR35 engagement offers autonomy to evaluate current architecture and implement robust, real-time data pipelines across multi-cloud environments.

You will own the delivery of multi-cloud data flows using Python, SQL, Spark, dbt, and Terraform, with CI/CD and data governance as core priorities.

Qualifications

• Senior Data Engineer with Outside IR35 consultancy status and London-based delivery.
• Experience delivering multi-cloud data platforms and real-time pipelines.
• Autonomy to evaluate architecture and implement infrastructure improvements.

Responsibilities

• Design and optimize multi-cloud data flows across AWS, GCP, and Azure.
• Build, maintain, and scale ETL/ELT pipelines for high-throughput processing.
• Optimize data lakehouse architectures and modern data stack tooling.
• Drive governance, CI/CD, and data quality practices.

Skills

Multi-Cloud Architecture

Pipeline Engineering

Data Lakehouse

Modern Tooling

CI/CD

Data quality

Independent Execution

Python

SQL

Spark

dbt

Terraform

CloudFormation

PySpark

Tools

Terraform

CloudFormation

Job description

• Initial Duration: 3 Months (High likelihood of extension)
• Location: London (Hybrid / Flexible remote pattern)
• Day Rate: Competitive Market Rate

The Role

Are you a seasoned Senior Data Engineer looking for your next high-impact assignment?

We are partnering with an ambitious, high-growth London tech organization to deliver a critical modernization phase of their core data platform. As an Outside IR35 engagement, this role requires an independent subject matter expert who can step in, evaluate current data architecture, and execute key infrastructure improvements across a dynamic multi-cloud setup.

You will have total technical autonomy to design, optimize, and deliver robust data pipelines that process massive real-time datasets.

Core Responsibilities

• Multi-Cloud Architecture: Optimize and streamline data flow across primary public cloud platforms (AWS & GCP / Azure).
• Pipeline Engineering: Build, maintain, and refine resilient, scalable ETL/ELT pipelines to support high-throughput data processing.
• Data Lakehouse Optimization: Elevate storage architectures, modern data stack tools, and query engines for maximum performance.
• Modern Tooling: Drive technical delivery using Python, SQL, Spark, dbt, and Terraform.
• Best Practices & Governance: Champion robust engineering standards around CI/CD, data quality, and automated monitoring.
• Data Engineering Mastery: Deep background in production-grade data pipeline architecture and orchestration.
• Multi-Cloud Exposure: Hands-on commercial expertise across at least two major cloud platforms (AWS, GCP, or Azure).
• Modern Data Stack: Expertise with Python, PySpark, SQL, and transformation frameworks like dbt.
• Infrastructure as Code: Proficiency with Terraform or CloudFormation to ensure repeatable deployment environments.
• Independent Execution: Ability to take direct ownership of project deliverables, work autonomously, and provide clear technical direction.

Why This Engagement?

• Clear Outside IR35 Status: Fully assessed and structured for independent consultancy delivery.
• High-Impact Architecture: Direct ownership of critical multi-cloud features rather than routine maintenance.
• Project Longevity: A fast-paced 3-month initial scope with a solid roadmap driving long-term extension potential.
• Flexible Working: Modern London-based workspace with a highly flexible hybrid rhythm.

Note on IR35 Compliance: This contract has been scoped strictly as a statement of work (SOW) for deliverable-based execution, providing autonomy over working methods, hours, and location.