Real-Time Data Engineer – Streaming Analytics

BBC Group and Public Services; Greater London; Hybrid; GBP 53,000 - 58,000; Full time

Benefits offered by this job

Flexible working

25 days annual leave

Pensions

Health care and gym discount

Job summary

BBC Group and Public Services in London is seeking a Software Engineer to design and build data products for media distribution. You will maintain a petabyte-scale data lake, extend ETL pipelines, and develop a real-time stream processing system for operational monitoring.

You will collaborate with stakeholders and engineers to deliver impactful data solutions that enhance streaming experiences, with a hybrid work pattern at London Broadcasting House.

Qualifications

• Proven experience with data engineering pipelines and real-time streaming.
• Experience with cloud data services (AWS/GCP/Azure).
• Familiarity with data lakes, data modeling and ETL processes.

Responsibilities

• Design and build data products to understand media distribution.
• Maintain and extend a petabyte-scale data lake and ETL processes.
• Develop real-time streaming pipeline for operational monitoring.
• Collaborate with stakeholders and engineers to elicit requirements and deliver impactful products.
• Contribute to engineering excellence and best practices.

Skills

Python/SQL/Java

Databases

Spark/Kafka/Flink

Cloud services

Third-party data providers

Tools

Looker

Grafana

PowerBI

Job description

BBC Group and Public Services in London is seeking a Software Engineer to design and build data products for media distribution. You will maintain a petabyte-scale data lake, extend ETL pipelines, and develop a real-time stream processing system for operational monitoring.

You will collaborate with stakeholders and engineers to deliver impactful data solutions that enhance streaming experiences, with a hybrid work pattern at London Broadcasting House.