Data Engineer jobs in United Kingdom

This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board.

The IT Data Engineering Manager will play a pivotal role in advancing the data maturity of the Data & AI department by owning and delivering the data engineering roadmap. They will manage the Data Engineering team, providing best practices and specialized support as an expert and consultant to deliver solutions that enable the business to maximize value.

The IT Data Engineering Manager will be responsible for the entire engineering lifecycle, from data ingestion to transformation to serving. They will support the development and optimization of the environment and platforms to ensure ongoing growth and adherence to industry best practices.

• Define and implement data engineering strategies and best practices
• Oversee data platform architecture for scalability and reliability
• Lead and manage a team of data engineers
• Collaborate with architects, analysts, and business teams to align data solutions with organizational goals
• Manage the data engineering roadmap, ensuring it delivers tangible value to Greene King
• Oversee the end-to-end data engineering lifecycle for new data sources
• Support development and optimization of data engineering tools, processes, and environments
• Maintain and optimize existing data pipelines
• Document data pipelines and processes
• Test deployed solutions for accuracy and fault tolerance
• Ensure compliance with all regulations regarding data solutions and usage
• Review and optimize data quality across the central data platform
• Collaborate with data architects to deliver aligned data solutions
• Work with digital analytics, BI, and ETL teams to ensure data management and transformation alignment
• Engage with cross-functional teams to understand requirements and challenges
• Map data flows to identify value opportunities
• Maintain records of system integrations, data flows, and related documentation
• Estimate cloud service requirements and costs in collaboration with cloud engineering teams
• Research emerging trends in data engineering, AI, and data science

We offer a competitive salary, pension contribution, and benefits including career development, discounts, employee assistance programs, and more.

• Degree in mathematics, statistics, computer science, or related field
• Extensive knowledge of data engineering standards and practices
• Experience with ELT/ETL, Batch, Streaming, API, Eventing, Pub/Sub
• Proficiency in SQL, Python, and other coding languages
• Experience with Azure DevOps, Data Modeling, Lakehouse, Databricks, Azure Cloud Infrastructure and Security
• Experience with Delta/Iceberg formats, data ingestion patterns, troubleshooting, and data as a product
• Team management and development experience
• Excellent communication skills for technical and non-technical audiences
• Experience in a multi-brand, fast-paced industry
• Stakeholder management skills and ability to analyze business challenges for data requirements

Additional information about the role and qualifications is provided above.