Senior Data Engineering Lead: BigQuery, dbt & DataOps

Adelphi Group; Greater London; On-site; GBP 65,000 - 90,000; Full time

Job summary

Omnicom Media in London is seeking a Data Engineer to own and extend our config-driven data platform (DMI). You will build ELT pipelines from Cloud Function ingestion into BigQuery and dbt-powered transformations, ensuring data integrity and scalability.

You will mentor a team of data engineers, drive DataOps, and collaborate with analysts and BI teams to maximise value from data models across multiple clients. In-office 3 days a week as stated.

Qualifications

• Strong experience with dbt including macros, Jinja templating, incremental models, seeds, testing, and packages.
• Proficient in Python 3.11+ building CLI tools, data processing, and automation.
• Proficient in SQL, ideally BigQuery dialect.
• Experience with Google Cloud Platform especially BigQuery, Cloud Run, Cloud Functions, Cloud Storage, Pub/Sub, and Cloud Scheduler.
• Experience with Infrastructure as Code (Terraform) for provisioning and managing cloud resources.
• Solid understanding of data modelling techniques (star schema, dim/fact architecture, slowly changing dimensions).
• Comfortable with Git (GitHub, branching strategies, pull requests) and CI/CD (Cloud Build or similar).
• Ability to translate business needs into technical specifications.

Responsibilities

• Own and extend the end-to-end data pipeline from Cloud Function ingestion through dbt transformation (staging → intermediate → marts) to analysis-ready tables in BigQuery.
• Develop and maintain dbt macros, Jinja templates, and platform YAML definitions that auto-generate models across 26+ ad platforms.
• Manage and improve GCP infrastructure (BigQuery, Cloud Run, Cloud Functions, Cloud Scheduler, Pub/Sub) provisioned via Terraform.
• Build and maintain the Python CLI tooling that orchestrates client onboarding, config compilation, and pipeline execution.
• Mentor the team of data engineers, driving best practices in DataOps, code review, testing, and documentation.
• Proactively review existing processes to identify opportunities to automate manual work, optimise data delivery, and re-design infrastructure for greater scalability.
• Collaborate with analysts, data scientists, and BI teams (PowerBI, Looker Studio, Tableau, etc.) to maximise the value delivered from data models.
• Contribute to CI/CD pipelines (Cloud Build), testing (pytest, dbt tests), and documentation ( MkDocs, etc.).

Skills

dbt macros

Python CLI tools

SQL (BigQuery)

GCP (BigQuery, Cloud Run)

Terraform

Git & CI/CD

Data modelling

DataOps

Testing (pytest)

Documentation

Tools

Docker

dbt

Terraform

Cloud Build

MkDocs

Looker Studio

Job description

Omnicom Media in London is seeking a Data Engineer to own and extend our config-driven data platform (DMI). You will build ELT pipelines from Cloud Function ingestion into BigQuery and dbt-powered transformations, ensuring data integrity and scalability.

You will mentor a team of data engineers, drive DataOps, and collaborate with analysts and BI teams to maximise value from data models across multiple clients. In-office 3 days a week as stated.