Azure & Databricks Data Engineer — Scalable Pipelines

Anglian Water Group; Peterborough; Remote; GBP 41,000 - 51,000; Full time

Benefits offered by this job

Personal private health care

Life cover – 8x annual salary

26 days holiday + bank holidays

Flexible working opportunities

Competitive pension – company match up

Job summary

Anglian Water is seeking a Data Engineer to design, build and manage data platforms and pipelines across a major UK infrastructure programme. You will work in the @one Alliance Digital, Data and Innovation Team, enabling scalable data solutions for reporting, analytics and operational decision-making.

You will contribute to data ingestion, transformation, and governance across Bronze, Silver and Gold assets, collaborating with partners like Microsoft, Databricks and Cambridge/Cranfield

Qualifications

• Minimum 2 years experience in a Data Engineering role
• Experience designing and developing data pipelines, ETL processes, and data integration solutions
• Strong knowledge of Microsoft Azure data services and Databricks
• Experience with data lakes, data warehouses, and modern cloud-based data architectures
• Understanding of data modelling, metadata management, data lineage, and governance principles
• Proficiency in SQL and data engineering technologies
• Knowledge of CI/CD principles in data engineering environments
• Experience integrating data across multiple business systems
• Strong analytical and troubleshooting skills with focus on data quality

Responsibilities

• Designing, building, and maintaining scalable data pipelines within Microsoft Azure and Databricks environments
• Developing robust data ingestion, transformation, and integration processes from multiple data sources
• Managing and optimising enterprise data architecture using Bronze, Silver, and Gold medallion frameworks
• Ensuring data quality, accuracy, governance, and traceability across data assets
• Supporting reporting and analytics by making trusted data available through centralised platforms
• Managing APIs and integrations between key digital systems and platforms
• Creating and maintaining technical documentation, data lineage models, architecture diagrams, and metadata standards
• Monitoring, troubleshooting, and resolving data-related issues to ensure reliable service delivery
• Supporting CI/CD practices and the industrialisation of data products
• Developing proof-of-concept and minimum viable product solutions
• Collaborating with analysts, data scientists, and stakeholders to deliver value-driven outcomes
• Identifying opportunities to improve business performance through innovative uses of data and emerging technologies

Skills

Azure

Databricks

SQL

ETL

CI/CD

Data governance

Data modeling

Data lakes/warehouses

Python scripting

Tools

Microsoft Azure data services

Databricks

Job description

Anglian Water is seeking a Data Engineer to design, build and manage data platforms and pipelines across a major UK infrastructure programme. You will work in the @one Alliance Digital, Data and Innovation Team, enabling scalable data solutions for reporting, analytics and operational decision-making.

You will contribute to data ingestion, transformation, and governance across Bronze, Silver and Gold assets, collaborating with partners like Microsoft, Databricks and Cambridge/Cranfield