Senior Data Engineer: Cloud Pipelines & Integrations Hybrid

BBC; Salford; Hybrid; GBP 55,000 - 65,000; Full time

Job summary

The Senior Data Engineer at BBC will design, build and maintain scalable cloud-based data pipelines and data products that power audience growth and analytics. You will integrate BBC Account, mParticle, CRM platforms and marketing tech across enterprise reporting systems.

You will collaborate with analysts, engineers and product teams to automate and optimize data flows, while ensuring privacy, governance and regulatory compliance across geographies. Hybrid work is supported.

Qualifications

• Strong experience designing, building and maintaining scalable data pipelines and integration solutions using Apache Airflow (or similar orchestration platforms), Python, SQL and bash/linux.
• Experience developing cloud-native data platforms and solutions on AWS, including working with cloud data warehouse technologies such as Amazon Redshift and applying data modelling best practices.
• Good understanding of software engineering principles, including object-oriented development, testing practices, version control, code quality management, CI/CD deployment processes, containerisation, and LLM-assisted coding.
• Experience working with data processing and database technologies, including relational databases, query optimisation, performance tuning, monitoring, backup and recovery, and an understanding of different data structures and their appropriate use cases.
• Experience delivering data integrations for Customer Data Platforms (CDPs) and external data sources, including technologies such as mParticle, Twilio Segment, or similar customer data and marketing technology platforms.

Responsibilities

• Design, build and maintain scalable cloud-based data pipelines and data products supporting audience growth, CRM activation, marketing measurement and performance analytics.
• Build and maintain integrations between BBC Account, mParticle, CRM platforms, marketing technologies, advertising platforms and enterprise reporting systems.
• Develop robust API-based integrations to enable secure and reliable exchange of data across marketing, product, audience and analytics platforms.
• Collaborate with analysts, data scientists, engineers, product managers and business stakeholders to identify opportunities for automation, optimisation and improved decision making.
• Ensure all solutions are designed and implemented in accordance with BBC standards for privacy, data governance, security, consent management and international regulatory compliance.

Skills

Airflow

Python

SQL

bash/Linux

AWS

Amazon Redshift

Data modelling

CI/CD

Containerisation

LLM coding

CDP integrations

Tools

AWS

Amazon Redshift

mParticle

Twilio Segment

CloudFormation

Terraform

Streamlit

Shiny

Job description

The Senior Data Engineer at BBC will design, build and maintain scalable cloud-based data pipelines and data products that power audience growth and analytics. You will integrate BBC Account, mParticle, CRM platforms and marketing tech across enterprise reporting systems.

You will collaborate with analysts, engineers and product teams to automate and optimize data flows, while ensuring privacy, governance and regulatory compliance across geographies. Hybrid work is supported.