Senior Data Engineer: Cloud Data Platforms & Pipelines

Appcast Enterprise; Sunbury-on-Thames; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

bp in Sunbury, near London, is seeking an experienced Senior Data Engineer to design, build and operate scalable data platforms, pipelines and products that empower finance and analytics. You will apply modern cloud data technologies and rigorous software engineering practices to deliver trusted, secure data products.

You will collaborate with business partners, product teams and architects, lead technical delivery, drive engineering excellence, and help establish data engineering standards

Qualifications

• Significant experience delivering enterprise-scale data engineering solutions.
• Strong SQL and data modelling expertise.
• Experience with cloud data platforms, with Azure experience preferred.
• Experience building ELT/ETL pipelines and data integration solutions.
• Strong software engineering practices, including source control, testing, CI/CD and automation.
• Experience with big data, streaming and modern data architectures.
• Knowledge of security, access controls and data governance requirements.

Responsibilities

• Design, develop and maintain scalable data pipelines and integrations.
• Build and operate cloud-based data platforms, data products and analytical datasets.
• Develop reusable frameworks, automation and engineering patterns to accelerate delivery.
• Ensure data solutions are secure, performant, resilient and cost-efficient.
• Implement CI/CD, automated testing, monitoring and observability across data platforms.
• Translate business requirements into data models, pipelines and technical solutions.
• Design logical and physical data models supporting reporting, analytics, AI and operational use cases.
• Collaborate with enterprise and solution architects to align solutions with strategic technology standards.
• Evaluate new technologies and recommend improvements to existing platforms.
• Support implementation of data governance, quality, lineage and metadata management practices.
• Ensure data assets meet regulatory, audit and control requirements.
• Drive improvements in data quality and trusted data consumption.
• Provide technical leadership across delivery teams.
• Mentor and coach data engineers and development teams.
• Collaborate with Product Managers, Data Scientists, AI Engineers and Finance stakeholders.
• Contribute to engineering standards, best practices and continuous improvement initiatives.

Skills

Data engineering

SQL modelling

Azure

ETL/ELT pipelines

CI/CD

Big data

Security governance

Data platforms

Data streaming

Tools

Databricks

Microsoft Fabric

Snowflake

Job description

bp in Sunbury, near London, is seeking an experienced Senior Data Engineer to design, build and operate scalable data platforms, pipelines and products that empower finance and analytics. You will apply modern cloud data technologies and rigorous software engineering practices to deliver trusted, secure data products.

You will collaborate with business partners, product teams and architects, lead technical delivery, drive engineering excellence, and help establish data engineering standards