IT Engineer – Data Pipelines and Infrastructure

Exec Capital Recruitment; Greater London; On-site; GBP 45,000 - 75,000; Full time

Job summary

Exec Capital Recruitment is seeking a data engineer for a London-based role focused on building and operating automated ELT pipelines feeding a data warehouse from social APIs, analytics, and CRM sources. You will implement data schemas, monitor pipeline health, and ensure governance for a first-party behavioural data engine.

You will work with a team to deliver reliable data feeds and support a behavioural dashboard, applying best practices in data quality and operational reliability.

Qualifications

• 1-4 years of experience building or maintaining production data pipelines.
• Strong SQL and Python abilities.
• Experience with third-party APIs; social platform API experience is a plus.
• Familiarity with cloud data warehouses like BigQuery or Snowflake and ELT tooling (Fivetran, Airbyte, dbt).
• Methodical, reliable approach and adherence to data governance standards.

Responsibilities

• Build and maintain automated ELT pipelines pulling from TikTok, Instagram, YouTube and other platform APIs, Google Analytics, newsletter/CRM and commerce sources
• Implement agreed data schemas and cohort structures consistently across sources
• Monitor pipeline health, handle schema drift and API changes, and fix issues as they arise
• Apply data governance rules already defined for the project — retention windows, consent flags, provenance tagging
• Support the team building the internal behavioural dashboard with clean, reliable data feeds

Skills

SQL

Python

APIs

data governance

operational reliability

Tools

Fivetran

Airbyte

dbt

BigQuery

Snowflake

Job description

Our client is a London-based youth-culture media group whose brands reach an audience of more than 120 million people every month, producing work for 75+ global brand partners. The business is building out a first-party behavioural data engine that turns what its audience watches, joins and responds to into structured, consented signal.

This role is focused on the practical, day-to-day engineering that keeps that data engine running: building and maintaining the pipelines, keeping the infrastructure reliable, and turning agreed designs into working systems.

The Role

You will build and operate the automated pipelines that feed the company's data warehouse from social platform APIs, web analytics, newsletter/CRM and campaign reporting sources. You'll work to schemas and governance standards set by the senior technical lead on the project, focusing on reliable delivery, clean implementation and day-to-day operational ownership.

Responsibilities

What You'll Do

• Build and maintain automated ELT pipelines pulling from TikTok, Instagram, YouTube and other platform APIs, Google Analytics, newsletter/CRM and commerce sources
• Implement agreed data schemas and cohort structures consistently across sources
• Monitor pipeline health, handle schema drift and API changes, and fix issues as they arise
• Apply data governance rules already defined for the project — retention windows, consent flags, provenance tagging
• Support the team building the internal behavioural dashboard with clean, reliable data feeds

Qualifications

What We're Looking For

• 1-4 years' experience building or maintaining production data pipelines
• Solid SQL and Python
• Experience working with third-party APIs — social platform API experience a plus
• Familiarity with a cloud data warehouse (e.g. BigQuery or Snowflake) and ELT tooling (e.g. Fivetran, Airbyte, dbt)
• A methodical, reliable approach to operational work and a willingness to follow data governance standards closely