Data Pipelines & Infrastructure Engineer

Exec Capital Recruitment; Greater London; On-site; GBP 45,000 - 75,000; Full time

Job summary

Exec Capital Recruitment is seeking a data engineer for a London-based role focused on building and operating automated ELT pipelines feeding a data warehouse from social APIs, analytics, and CRM sources. You will implement data schemas, monitor pipeline health, and ensure governance for a first-party behavioural data engine.

You will work with a team to deliver reliable data feeds and support a behavioural dashboard, applying best practices in data quality and operational reliability.

Qualifications

• 1-4 years of experience building or maintaining production data pipelines.
• Strong SQL and Python abilities.
• Experience with third-party APIs; social platform API experience is a plus.
• Familiarity with cloud data warehouses like BigQuery or Snowflake and ELT tooling (Fivetran, Airbyte, dbt).
• Methodical, reliable approach and adherence to data governance standards.

Responsibilities

• Build and maintain automated ELT pipelines pulling from TikTok, Instagram, YouTube and other platform APIs, Google Analytics, newsletter/CRM and commerce sources
• Implement agreed data schemas and cohort structures consistently across sources
• Monitor pipeline health, handle schema drift and API changes, and fix issues as they arise
• Apply data governance rules already defined for the project — retention windows, consent flags, provenance tagging
• Support the team building the internal behavioural dashboard with clean, reliable data feeds

Skills

SQL

Python

APIs

data governance

operational reliability

Tools

Fivetran

Airbyte

dbt

BigQuery

Snowflake

Job description

Exec Capital Recruitment is seeking a data engineer for a London-based role focused on building and operating automated ELT pipelines feeding a data warehouse from social APIs, analytics, and CRM sources. You will implement data schemas, monitor pipeline health, and ensure governance for a first-party behavioural data engine.

You will work with a team to deliver reliable data feeds and support a behavioural dashboard, applying best practices in data quality and operational reliability.