Senior Data Engineer

BBC Group and Public Services; City Of London; Hybrid; GBP 55,000 - 65,000; Full time

Job summary

The Senior Data Engineer at BBC Group and Public Services will shape data pipelines and platforms that empower audience insights and marketing analytics. You’ll work in the Audience Data team to design, build and maintain cloud-based data products, ensuring scalable, secure data flows across CRM, analytics and product platforms.

Based in Salford or London with hybrid working, you’ll collaborate with analysts, data scientists and engineers to automate processes, optimise data delivery and uphold

Qualifications

• Strong experience designing, building and maintaining scalable data pipelines using Airflow, Python, SQL.
• Experience with AWS data platforms and Redshift.
• Knowledge of CI/CD, testing, version control, containerisation and deployment practices.
• Experience delivering data integrations for CDPs and external sources like mParticle or Twilio Segment.
• Familiarity with privacy, governance, security and regulatory compliance.

Responsibilities

• Design, build and maintain scalable cloud-based data pipelines and data products supporting audience growth, CRM activation, marketing measurement and performance analytics.
• Build and maintain integrations between BBC Account, mParticle, CRM platforms, marketing technologies, advertising platforms and enterprise reporting systems.
• Develop robust API-based integrations to enable secure and reliable data exchange across platforms.
• Collaborate with analysts, data scientists, engineers, product managers and business stakeholders to identify opportunities for automation, optimisation and improved decision making.
• Ensure all solutions are designed and implemented in accordance with BBC standards for privacy, data governance, security, consent management and international regulatory compliance.

Skills

Airflow

Python

SQL

Bash/Linux

AWS

Redshift

CI/CD

Data integration

Data modeling

Education

Bachelor's degree in a relevant field

Tools

mParticle

Twilio Segment

Terraform

CloudFormation

Job description

London, GBR, W1A 1AA
| Salford, GBR, M50 2QH

JOB DETAILS

JOB BAND: D
CONTRACT TYPE: x1 Permanent and x1 12 month FTC / Attachment, Full-time
DEPARTMENT: CCOG Data Engineering
LOCATION: Salford or London / Hybrid
PROPOSED SALARY RANGE: £55,000 - £65,000 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects internal benchmarking and external market insights.

We're happy to discuss flexible working. If you'd like to, please indicate your preference in the application – though there's no obligation to do so now. Flexible working will be part of the discussion at offer stage.

PURPOSE OF THE ROLE

The Senior Data Engineer plays a key role within the Audience Data team, designing, building and maintaining the data pipelines and infrastructure that enable teams across the BBC to make effective use of data. Working closely with Analytics, Data Science, Marketing, Brand and other business functions, the role is responsible for delivering reliable, scalable and trusted data solutions that support audience insight, engagement and decision-making.

WHY JOIN THE TEAM

The BBC aims to stimulate and delight audiences across the UK with distinctive, creative content. To support this aim, BBC is entering a new charter period of significant and exciting change, developing new capabilities in order to define a BBC fit for the next generation.

YOUR KEY RESPONSIBILITIES AND IMPACT

• Design, build and maintain scalable cloud-based data pipelines and data products supporting audience growth, CRM activation, marketing measurement and performance analytics.
• Build and maintain integrations between BBC Account, mParticle, CRM platforms, marketing technologies, advertising platforms and enterprise reporting systems.
• Develop robust API-based integrations to enable secure and reliable exchange of data across marketing, product, audience and analytics platforms.
• Collaborate with analysts, data scientists, engineers, product managers and business stakeholders to identify opportunities for automation, optimisation and improved decision making.
• Ensure all solutions are designed and implemented in accordance with BBC standards for privacy, data governance, security, consent management and international regulatory compliance.

YOUR SKILLS AND EXPERIENCE

ESSENTIAL CRITERIA

• Strong experience designing, building and maintaining scalable data pipelines and integration solutions using Apache Airflow (or similar orchestration platforms), Python, SQL and bash/linux.
• Experience developing cloud-native data platforms and solutions on AWS, including working with cloud data warehouse technologies such as Amazon Redshift and applying data modelling best practices.
• Good understanding of software engineering principles, including object-oriented development, testing practices, version control, code quality management, CI/CD deployment processes, containerisation, and LLM-assisted coding.
• Experience working with data processing and database technologies, including relational databases, query optimisation, performance tuning, monitoring, backup and recovery, and an understanding of different data structures and their appropriate use cases.
• Experience delivering data integrations for Customer Data Platforms (CDPs) and external data sources, including technologies such as mParticle, Twilio Segment, or similar customer data and marketing technology platforms.

DESIRABLE

• Experience implementing layered data architecture patterns (e.g. Medallion Architecture, Data Warehouse or Lakehouse approaches) to support data quality, governance and scalability.
• Contributingto the developmentof area of specialism or industry domain
• Broadcast, production, start-up or media experience
• A mix of public sector and commercial experience
• Successful academic background in your specialist discipline
• Familiarity with Retrieval-Augmented Generation (RAG), vector databases, embeddings, and other patterns used to support Generative AI solutions on platforms such as Amazon Bedrock.
• Experience developing data-based apps in Streamlit/Shiny
• Skills in ‘Big Data’ technology tools like Hadoop/Spark
• Knowledge of Infrastructure as Code tools like CloudFormation/Terraform

If you can bring some of these skills and experiences, along with transferable strengths, we’d love to hear from you and encourage you to apply.

Before your start date, you may need to disclose any unspent convictions or police charges, in line with our Contracts of Employment policy. This allows us to discuss any support you may need and assess any risks. Failure to disclose may result in the withdrawal of your offer.

Disclaimer

This job description is a written statement of the essential characteristics of the job, with its principal accountabilities, incorporating a note of the skills, knowledge and experience required for a satisfactory level of performance. This is not intended to be a complete, detailed account of all aspects of the duties involved.

Please note: If you were to be offered this role, the BBC will conduct Employment screening checks which include Reference checks; Eligibility to work checks; and if applicable to the role, Safeguarding and Adverse media/Social media checks. Any offer made is conditional on these checks being satisfactory.

Before your start date, you may need to disclose any unspent convictions or police charges, in line with our Recruitment policy. This allows us to discuss any support you may need and assess any risks. Failure to disclose may result in the withdrawal of your offer.

Redeployment

The BBC is committed to redeploying employees seeking suitable alternative employment within the BBC and they will be given priority consideration ahead of other applicants. Priority consideration means for those employees seeking redeployment their application will be considered alongside anyone else at risk of redundancy, prior to any individuals being considered who are not at risk.

Information at a Glance

This is your BBC

At the BBC you can create and innovate in an inclusive environment while contributing to some of the world’s best loved content, and the BBC’s mission to inform, educate and entertain.

Find out more about the BBC

Life at BBC

Here you will benefit from:

• Fair pay and flexible benefits including a competitive salary package, a flexible 35-hour working week, 25 days annual leave with the option to buy an extra 5 days, a defined pensionscheme and discounted dental, health care and gym.
• Excellent career and professional development.
• Support in your working life, including flexible working which you can discuss with us at any point during the application, selection or offer.
• A values-based organisation where the way we do things is important as what we do.

Benefits may vary if you are joining on an FTC basis or on an orchestra conditions contract.

Learn more about life at the BBC and our values in our candidate pack.

Candidate pack

You belong

We have a working environment where we value and respect every individual's unique contribution, so all our employees feel that they can belong, thrive and achieve their full potential.

We want to attract the broadest range of talented people to join us. The more diverse our workforce, the better able we are to respond to and reflect our audiences in all their diversity.

We welcome applications from individuals, regardless of age, gender, ethnicity, disability, sexual orientation, gender identity, socio-economic background, religion and/or belief.

Find out more about diversity, inclusion and belonging in our strategy below.

Diversity, inclusion & belonging strategy

Disability confident

We are a disability confident employer. If you need to discuss adjustments or access requirements for the interview process, or to carry out this role, please contact us via email and we’d be happy to discuss: [e-mail]

BBC Group and Public Services, Broadcasting House, Portland Place, London, United Kingdom, W1A 1AA. BBC Studios Distribution Limited, company no: 01420028, registered address: 1 Television Centre, 101 Wood Lane, London, United Kingdom W12 7FA.