Senior Data Engineer

BBC; Salford; Hybrid; GBP 55,000 - 65,000; Full time

Job summary

The Senior Data Engineer at BBC will design, build and maintain scalable cloud-based data pipelines and data products that power audience growth and analytics. You will integrate BBC Account, mParticle, CRM platforms and marketing tech across enterprise reporting systems.

You will collaborate with analysts, engineers and product teams to automate and optimize data flows, while ensuring privacy, governance and regulatory compliance across geographies. Hybrid work is supported.

Qualifications

• Strong experience designing, building and maintaining scalable data pipelines and integration solutions using Apache Airflow (or similar orchestration platforms), Python, SQL and bash/linux.
• Experience developing cloud-native data platforms and solutions on AWS, including working with cloud data warehouse technologies such as Amazon Redshift and applying data modelling best practices.
• Good understanding of software engineering principles, including object-oriented development, testing practices, version control, code quality management, CI/CD deployment processes, containerisation, and LLM-assisted coding.
• Experience working with data processing and database technologies, including relational databases, query optimisation, performance tuning, monitoring, backup and recovery, and an understanding of different data structures and their appropriate use cases.
• Experience delivering data integrations for Customer Data Platforms (CDPs) and external data sources, including technologies such as mParticle, Twilio Segment, or similar customer data and marketing technology platforms.

Responsibilities

• Design, build and maintain scalable cloud-based data pipelines and data products supporting audience growth, CRM activation, marketing measurement and performance analytics.
• Build and maintain integrations between BBC Account, mParticle, CRM platforms, marketing technologies, advertising platforms and enterprise reporting systems.
• Develop robust API-based integrations to enable secure and reliable exchange of data across marketing, product, audience and analytics platforms.
• Collaborate with analysts, data scientists, engineers, product managers and business stakeholders to identify opportunities for automation, optimisation and improved decision making.
• Ensure all solutions are designed and implemented in accordance with BBC standards for privacy, data governance, security, consent management and international regulatory compliance.

Skills

Airflow

Python

SQL

bash/Linux

AWS

Amazon Redshift

Data modelling

CI/CD

Containerisation

LLM coding

CDP integrations

Tools

AWS

Amazon Redshift

mParticle

Twilio Segment

CloudFormation

Terraform

Streamlit

Shiny

Job description

JOB DETAILS

JOB BAND: D

CONTRACT TYPE: x1 Permanent and x1 12 month FTC / Attachment, Full-time

DEPARTMENT: CCOG Data Engineering

LOCATION: Salford or London / Hybrid

PROPOSED SALARY RANGE: £55,000 - £65,000 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects internal benchmarking and external market insights.

We're happy to discuss flexible working. If you'd like to, please indicate your preference in the application – though there's no obligation to do so now. Flexible working will be part of the discussion at offer stage.

PURPOSE OF THE ROLE

The Senior Data Engineer plays a key role within the Audience Data team, designing, building and maintaining the data pipelines and infrastructure that enable teams across the BBC to make effective use of data. Working closely with Analytics, Data Science, Marketing, Brand and other business functions, the role is responsible for delivering reliable, scalable and trusted data solutions that support audience insight, engagement and decision-making.

WHY JOIN THE TEAM

The BBC aims to stimulate and delight audiences across the UK with distinctive, creative content. To support this aim, BBC is entering a new charter period of significant and exciting change, developing new capabilities in order to define a BBC fit for the next generation.

Your Key Responsibilities And Impact

• Design, build and maintain scalable cloud-based data pipelines and data products supporting audience growth, CRM activation, marketing measurement and performance analytics.
• Build and maintain integrations between BBC Account, mParticle, CRM platforms, marketing technologies, advertising platforms and enterprise reporting systems.
• Develop robust API-based integrations to enable secure and reliable exchange of data across marketing, product, audience and analytics platforms.
• Collaborate with analysts, data scientists, engineers, product managers and business stakeholders to identify opportunities for automation, optimisation and improved decision making.
• Ensure all solutions are designed and implemented in accordance with BBC standards for privacy, data governance, security, consent management and international regulatory compliance.

YOUR SKILLS AND EXPERIENCE

• Strong experience designing, building and maintaining scalable data pipelines and integration solutions using Apache Airflow (or similar orchestration platforms), Python, SQL and bash/linux.
• Experience developing cloud-native data platforms and solutions on AWS, including working with cloud data warehouse technologies such as Amazon Redshift and applying data modelling best practices.
• Good understanding of software engineering principles, including object-oriented development, testing practices, version control, code quality management, CI/CD deployment processes, containerisation, and LLM-assisted coding.
• Experience working with data processing and database technologies, including relational databases, query optimisation, performance tuning, monitoring, backup and recovery, and an understanding of different data structures and their appropriate use cases.
• Experience delivering data integrations for Customer Data Platforms (CDPs) and external data sources, including technologies such as mParticle, Twilio Segment, or similar customer data and marketing technology platforms.

DESIRABLE

• Experience implementing layered data architecture patterns (e.g. Medallion Architecture, Data Warehouse or Lakehouse approaches) to support data quality, governance and scalability.
• Contributingto the developmentof area of specialism or industry domain
• Broadcast, production, start-up or media experience
• A mix of public sector and commercial experience
• Successful academic background in your specialist discipline
• Familiarity with Retrieval-Augmented Generation (RAG), vector databases, embeddings, and other patterns used to support Generative AI solutions on platforms such as Amazon Bedrock.
• Experience developing data-based apps in Streamlit/Shiny
• Skills in ‘Big Data’ technology tools like Hadoop/Spark
• Knowledge of Infrastructure as Code tools like CloudFormation/Terraform

If you can bring some of these skills and experiences, along with transferable strengths, we’d love to hear from you and encourage you to apply.

Before your start date, you may need to disclose any unspent convictions or police charges, in line with our Contracts of Employment policy. This allows us to discuss any support you may need and assess any risks. Failure to disclose may result in the withdrawal of your offer.

Disclaimer

This job description is a written statement of the essential characteristics of the job, with its principal accountabilities, incorporating a note of the skills, knowledge and experience required for a satisfactory level of performance. This is not intended to be a complete, detailed account of all aspects of the duties involved.

Please note: If you were to be offered this role, the BBC will conduct Employment screening checks which include Reference checks; Eligibility to work checks; and if applicable to the role, Safeguarding and Adverse media/Social media checks. Any offer made is conditional on these checks being satisfactory.

Before your start date, you may need to disclose any unspent convictions or police charges, in line with our Recruitment policy. This allows us to discuss any support you may need and assess any risks. Failure to disclose may result in the withdrawal of your offer.

For any general queries, please contact: [e-mail]

Redeployment

The BBC is committed to redeploying employees seeking suitable alternative employment within the BBC and they will be given priority consideration ahead of other applicants. Priority consideration means for those employees seeking redeployment their application will be considered alongside anyone else at risk of redundancy, prior to any individuals being considered who are not at risk.