Data Engineer

ITV Consumer Limited 2024; London Borough of Hammersmith and Fulham; Hybrid; GBP 70,000 - 95,000; Full time

Benefits offered by this job

Generous holiday allowance

Annual bonus opportunity

Competitive pension contribution

Save as you earn – ITV shares

Wellbeing and volunteering days

Job summary

ITV Consumer Limited 2024 is seeking a Data Engineer to join the BDE team and help operate the Synapse platform, ITV's operational data engine. You will enable high-quality data powering ITV's viewer experiences and collaborate across multiple geographies.

You will build streaming and batch pipelines on Dataflow and BigQuery, manage Terraform-based deployments, implement testing and observability, enforce security with GCP IAM, and participate in on-call duties to keep services resilient.

Qualifications

• Strong SQL, and proficient in at least one of Python, Java or Go with a willingness to pick up the others.
• Experience with streaming data, SQL-based transformation tooling, and CI/CD pipelines.
• Hands-on experience with GCP services (Pub/Sub, BigQuery, Dataflow, Composer/Airflow, Cloud Functions, GKE).

Responsibilities

• Pipeline Engineering: Build and maintain high-throughput streaming and batch pipelines on Dataflow and BigQuery.
• Infrastructure as Code: Deploy and manage services using Terraform.
• Testing & Quality: Write unit and integration tests as part of the Definition of Done.
• Observability: Set up metrics and alerting using Grafana & Prometheus.
• Security: Implement and manage fine-grained access through GCP IAM.
• Support & Rota: Participate in on-call rota and triage issues.

Skills

SQL

Python

Java

Go

Terraform

GCP

BigQuery

Dataflow

CI/CD

Monitoring

Tools

Terraform

Cloud Build

Kubernetes

Dataflow

BigQuery

Job description

As a Data Engineer in the BDE team, you will be a key contributor to the Synapse platform - ITV's operational data engine. We are currently on an ambitious journey to transition our data landscape to make it fit for future needs which collect and measure user behaviour, ensuring high-quality data powers ITV's core viewer experiences.,

• Pipeline Engineering: Build and maintain high-throughput streaming and batch pipelines on Dataflow and BigQuery, with Python for orchestration and tooling, utilising Go for the low-latency viewer-facing services, such as continue watching.
• Infrastructure as Code: Deploy and manage services using a "lego brick" Terraform methodology, with the flexibility to write custom pipelines when standard modules don't fit the use case.
• Testing & Quality: Write unit and integration tests as part of our Definition of Done, and help us move beyond after-the-event validation toward proactive, integrated testing, including load testing ahead of big live events.
• Observability: Set up metrics and alerting for what you ship, using native logging and monitoring dashboards defined in Terraform, alongside Grafana & Prometheus for deeper system metrics.
• Security: Implement and manage fine-grained access through GCP IAM to ensure data integrity and compliance.
• Support & Rota: Take part in the team's support and on-call rota, triaging support issues and bugs as they are reported. Critical issues with our viewer-facing services are picked up straight away, with everything else prioritised alongside planned engineering work.
  Cloud Platform: Hands-on experience with GCP (Pub/Sub, BigQuery, Dataflow, Composer/Airflow, Cloud Functions, GKE and Cloud Build), or equivalent experience on another cloud and a willingness to go deep on GCP.
• Languages: Strong SQL, and proficient in at least one of Python, Java or Go with a willingness to pick up the others.
• Data Tools: Experience with streaming data, SQL-based transformation tooling, and CI/CD pipelines.
• Infrastructure: Good knowledge of Terraform and of deploying containerised services.
• Architectural Awareness: Ability to work within a complex high-level architecture involving event-driven streaming and multi-project environments., Agile Mindset: Comfortable in a mature Agile environment, participating in daily standups, sprint planning, and retrospectives.
• Collaborative: Able to work in a matrix organisation and a distributed team (UK, Brazil and Spain), liaising with Product Managers and stakeholders across Personalisation, Marketing, Commercial and Finance to refine requirements into technical tasks.
• Continuous Improvement: A desire to improve existing validation tools and contribute to the team's "tool chest" of reusable components.
• AI-curious: We are actively experimenting with AI-assisted engineering (Claude Code, Gemini ADK, Vertex AI agents) and want people who are keen to learn to use it well.
  Flexible working with a range of options
• Generous holiday allowance, plus you can buy more
• Annual bonus opportunity
• Competitive pension contribution
• Save as you earn - with an opportunity to buy ITV shares
• Wellbeing and volunteering days plus a wide range of opportunities to help you live a balanced and healthy life
• More about our benefitsWhat is the magic of ITV? It starts with a simple love of television. Watching it, creating it, talking about it. Whether it's daytime or primetime, for downtime or anytime. We're inspired by our audiences. Who helps shape what we make. Standing shoulder to shoulder with them. Because what matters to them, matters to us. Starting conversations. Winning hearts. Changing minds and sometimes even society itself. Big or small, what we make makes an impact.