Senior Data Engineer - Cloud Pipelines & CDP Integrations

BBC Group and Public Services; City Of London; Hybrid; GBP 55,000 - 65,000; Full time

Job summary

The Senior Data Engineer at BBC Group and Public Services will shape data pipelines and platforms that empower audience insights and marketing analytics. You’ll work in the Audience Data team to design, build and maintain cloud-based data products, ensuring scalable, secure data flows across CRM, analytics and product platforms.

Based in Salford or London with hybrid working, you’ll collaborate with analysts, data scientists and engineers to automate processes, optimise data delivery and uphold

Qualifications

• Strong experience designing, building and maintaining scalable data pipelines using Airflow, Python, SQL.
• Experience with AWS data platforms and Redshift.
• Knowledge of CI/CD, testing, version control, containerisation and deployment practices.
• Experience delivering data integrations for CDPs and external sources like mParticle or Twilio Segment.
• Familiarity with privacy, governance, security and regulatory compliance.

Responsibilities

• Design, build and maintain scalable cloud-based data pipelines and data products supporting audience growth, CRM activation, marketing measurement and performance analytics.
• Build and maintain integrations between BBC Account, mParticle, CRM platforms, marketing technologies, advertising platforms and enterprise reporting systems.
• Develop robust API-based integrations to enable secure and reliable data exchange across platforms.
• Collaborate with analysts, data scientists, engineers, product managers and business stakeholders to identify opportunities for automation, optimisation and improved decision making.
• Ensure all solutions are designed and implemented in accordance with BBC standards for privacy, data governance, security, consent management and international regulatory compliance.

Skills

Airflow

Python

SQL

Bash/Linux

AWS

Redshift

CI/CD

Data integration

Data modeling

Education

Bachelor's degree in a relevant field

Tools

mParticle

Twilio Segment

Terraform

CloudFormation

Job description

The Senior Data Engineer at BBC Group and Public Services will shape data pipelines and platforms that empower audience insights and marketing analytics. You’ll work in the Audience Data team to design, build and maintain cloud-based data products, ensuring scalable, secure data flows across CRM, analytics and product platforms.

Based in Salford or London with hybrid working, you’ll collaborate with analysts, data scientists and engineers to automate processes, optimise data delivery and uphold