Senior Data Engineer: Cloud-Driven Data Pipelines

The Independent; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

The Independent is seeking a Senior Data Engineer to design, maintain and optimise its data infrastructure supporting analytics and reporting. You will own scalable data pipelines, integrating data from web analytics, CMS, subscription platforms, ad tech and social sources.

The role requires strong SQL, experience with cloud platforms (GCP/AWS) and data warehouses, plus the ability to automate workflows and collaborate with cross-functional teams. London-based role with a data-driven culture.

Qualifications

• Experience with SQL and multiple relational and non-relational databases.
• Design and maintain scalable data pipelines and architectures.
• Automate and optimize data workflows with ETL/ELT tools.
• Build data models and reporting layers for dashboards and analytics.
• Experience with cloud platforms (AWS, GCP) and data warehouses.
• Proactive, able to manage multiple data projects.
• Knowledge of GDPR and data privacy.

Responsibilities

• Design and maintain robust, scalable data pipelines to support current and future business needs.
• Assemble large, complex datasets from structured and unstructured sources to meet requirements.
• Identify, design, and implement improvements to automate processes and enhance data delivery.
• Build and manage ETL/ELT infrastructure using Python, SQL and GCP big data tech (BigQuery, Dataflow, Dataproc, Cloud Storage).
• Prepare and transform pipeline data to support downstream analytics and BI tools (e.g., DOMO).
• Collaborate with Data, Commercial and Editorial teams to address data challenges and needs.
• Continuously improve data systems' functionality, flexibility and performance.
• Ensure data handling is secure and compliant with GDPR and company policies.

Skills

SQL & database expertise

Big data engineering

Analytical problem solving

Unstructured data handling

Data workflow development

Project management & collaboration

Education in CS/STEM + 3+ yrs

Education

Graduate degree in Computer Science or STEM field

Tools

Apache Airflow

dbt

BigQuery

Spark

Python/Java

GCP

Job description

The Independent is seeking a Senior Data Engineer to design, maintain and optimise its data infrastructure supporting analytics and reporting. You will own scalable data pipelines, integrating data from web analytics, CMS, subscription platforms, ad tech and social sources.

The role requires strong SQL, experience with cloud platforms (GCP/AWS) and data warehouses, plus the ability to automate workflows and collaborate with cross-functional teams. London-based role with a data-driven culture.