Business Intelligence Engineer

Lidl; Greater London; Hybrid; GBP 53,000 - 70,000; Full time

Benefits offered by this job

35 days holiday (pro rata)

10% in-store discount

Pension scheme

Enhanced family leave

Job summary

Lidl is recruiting a BI Engineer for its Head Office Controlling department on a 23-month fixed term contract in London. You will build scalable data products, create trusted data layers, and enable robust reporting and visualisations.

The role focuses on ETL/ELT development, data governance, and modernising legacy processes within a hybrid work model. Strong SQL, Python, and cloud experience are essential, along with stakeholder collaboration.

Qualifications

• Expert-level SQL with advanced queries and window functions.
• Advanced Python for building data pipelines and automation.
• Cloud infrastructure experience (GCP) is highly advantageous.
• Experience migrating legacy VBA/Excel processes into modern tech stacks is advantageous.
• Project management experience from requirements through deployment and monitoring.
• Strong written and verbal communication to bridge business needs and technical execution.

Responsibilities

• Partner with Controlling to engineer trusted data layers for reporting and analysis.
• Design and implement ETL/ELT pipelines to structure complex datasets into reliable products.
• Develop and optimise data transformations using SQL and Python.
• Define data governance practices for data retrieval, quality, version control, and documentation.
• Modernise legacy processes by identifying automation opportunities and migrating to a modern stack.
• Ensure backend data models are aligned and optimized for BI visualisations.
• Manage data projects end-to-end from requirements to deployment and adoption.
• Communicate clearly with non-technical colleagues to build trust in data products.

Skills

SQL

Python

Cloud (GCP)

Legacy VBA/Excel migration

Project management

Communication

Stakeholder management

Data governance

Data modelling

Automation

Tools

Snowflake

BigQuery

GCP tools

Job description

Summary

£52,800* up to £70,400* per annum | 23-month Fixed Term Contract | 35 days' holiday (pro rata) | 10% in-store discount | Pension scheme

Everyone who works at Lidl brings something unique to the table - but we also have a whole lot in common. We're curious, collaborative, and ready to make a tangible impact on where we work.

Our Head Office Controlling department is looking to recruit a developer to join their Business Intelligence (BI) team on a 23-month fixed term contract. As a Business Intelligence (BI) Engineer at Lidl, you will be crucial to driving business impact through data integrity, robust architecture and actionable insight. In this role you will partner with stakeholders across the business to architect and transform raw business data into scalable and reliable data products, which will power intuitive reporting solutions/visualisations. Through the creation of a trusted semantic layer, you will empower both technical and non-technical colleagues in a fast paced environment to make data driven decisions.

This is a highly visible business intelligence function where stakeholder engagement, project ownership and the ability to converse both technically and non-technically are as important as your technical development skills.

At Lidl, we offer a hybrid working model to give you the best of both worlds. Spend three days or more in our state-of-the-art office, where you can enjoy an on-site gym, restaurant, and more of the perks you deserve. And with up to two days at home, you'll find the work/life balance you need to thrive.

To keep in line with company structure, this role will be called Consultant internally.

What you'll do

• Partner with colleagues in Controlling to provide support for all national departments, by engineering trusted data layers which will power reporting and analysis across the business.
• Design and implement ETL/ELT pipelines to extract, clean and structure complex datasets into reliable products.
• Develop and optimise complex data transformations using advanced SQL (Snowflake and Big Query) and Python.
• Define and implement data governance best practices for new methods of data retrieval, ensuring data quality, version control and comprehensive technical documentation.
• Modernise legacy processes by identifying opportunities for process improvements through automation and migration to a modern tech stack.
• Ensure that our back-end data models are aligned and optimised for BI visualisations.
• Manage data projects end-to-end: defining requirements, designing the architecture, conducting UAT and driving implementation\adoption.
• Communicate effectively with non-technical colleagues across the business to ensure understanding and build trust in our data products and reporting solutions.

What you'll need

• Expert-level SQL: Deep understanding of complex queries, window functions, and query optimisation in cloud data warehouses (Snowflake, BigQuery).
• Advanced Python: Proven ability to build data pipelines, automate processes, and manipulate data programmatically.
• Cloud Infrastructure: Experience working within cloud environments (GCP) is highly advantageous.
• Legacy Migration: Some experience of understanding and reverse-engineering legacy VBA/Excel macros to migrate them into modern tech stack is advantageous.
• Project Management: Proven experience owning data initiatives from requirement gathering through to deployment and monitoring.
• Communication & Stakeholder Management: Exceptional written and verbal skills, with experience in bridging the gap between business needs and technical execution.
• A curious, proactive mindset with a keen eye for detail, quality control, and scalable system design.
• Ability to work both independently on complex technical challenges and collaboratively within a cross-functional team.

What you'll receive

• 35 days holiday (pro rata)
• 10% in-store discount
• Enhanced family leave
• Pension scheme
• Plus, more of the perks you deserve

We value diversity, equity, and inclusion, welcoming applicants from all backgrounds. Join us to celebrate individuality and grow in a fair, respectful, and inclusive environment.

*Includes a 10% non-contractual London weighting