Data Engineer: Real-Time Pipelines & AI-Ready Platform

ITV Consumer Limited 2024; London Borough of Hammersmith and Fulham; Hybrid; GBP 70,000 - 95,000; Full time

Benefits offered by this job

Generous holiday allowance

Annual bonus opportunity

Competitive pension contribution

Save as you earn – ITV shares

Wellbeing and volunteering days

Job summary

ITV Consumer Limited 2024 is seeking a Data Engineer to join the BDE team and help operate the Synapse platform, ITV's operational data engine. You will enable high-quality data powering ITV's viewer experiences and collaborate across multiple geographies.

You will build streaming and batch pipelines on Dataflow and BigQuery, manage Terraform-based deployments, implement testing and observability, enforce security with GCP IAM, and participate in on-call duties to keep services resilient.

Qualifications

• Strong SQL, and proficient in at least one of Python, Java or Go with a willingness to pick up the others.
• Experience with streaming data, SQL-based transformation tooling, and CI/CD pipelines.
• Hands-on experience with GCP services (Pub/Sub, BigQuery, Dataflow, Composer/Airflow, Cloud Functions, GKE).

Responsibilities

• Pipeline Engineering: Build and maintain high-throughput streaming and batch pipelines on Dataflow and BigQuery.
• Infrastructure as Code: Deploy and manage services using Terraform.
• Testing & Quality: Write unit and integration tests as part of the Definition of Done.
• Observability: Set up metrics and alerting using Grafana & Prometheus.
• Security: Implement and manage fine-grained access through GCP IAM.
• Support & Rota: Participate in on-call rota and triage issues.

Skills

SQL

Python

Java

Go

Terraform

GCP

BigQuery

Dataflow

CI/CD

Monitoring

Tools

Terraform

Cloud Build

Kubernetes

Dataflow

BigQuery

Job description

ITV Consumer Limited 2024 is seeking a Data Engineer to join the BDE team and help operate the Synapse platform, ITV's operational data engine. You will enable high-quality data powering ITV's viewer experiences and collaborate across multiple geographies.

You will build streaming and batch pipelines on Dataflow and BigQuery, manage Terraform-based deployments, implement testing and observability, enforce security with GCP IAM, and participate in on-call duties to keep services resilient.