BI Engineer: Data Pipelines & Insights Architect

Lidl GB; Greater London; Hybrid; GBP 53,000 - 70,000; Full time

Benefits offered by this job

35 days holiday

10% in-store discount

Enhanced family leave

Pension scheme

London weighting

Job summary

Lidl GB is seeking a Business Intelligence Engineer on a 23‑month fixed‑term contract in London. You will partner with the Controlling team to build trusted data layers and scalable data products that power reporting and insights across the business.

The role requires expert SQL and Python, hands-on cloud data warehousing (Snowflake, BigQuery), and strong stakeholder management. You will modernise legacy processes, ensure data quality, and drive adoption of data solutions in a hybrid environment.

Qualifications

• Expert-level SQL with complex queries and window functions.
• Advanced Python for building data pipelines and automation.
• Experience in cloud environments (GCP) is highly advantageous.
• Experience migrating legacy VBA/Excel workflows to modern stacks is advantageous.
• Proven project management experience from requirement gathering to deployment.
• Excellent written and verbal communication with stakeholders.
• A proactive mindset with attention to detail and scalable design.
• Ability to work independently and in cross-functional teams.

Responsibilities

• Partner with Controlling to engineer trusted data layers for reporting and analysis.
• Design and implement ETL/ELT pipelines for complex datasets.
• Develop and optimise data transformations using SQL and Python.
• Define data governance and documentation; ensure data quality and version control.
• Modernise legacy processes and migrate to a modern tech stack.
• Ensure backend data models are aligned and optimised for BI visuals.
• Manage data projects end-to-end from requirements to adoption.
• Communicate with non-technical colleagues to build trust in data products.

Skills

SQL

Python

Cloud (GCP)

VBA/Macros

Project Management

Communication

Stakeholder management

Team collaboration

Tools

Snowflake

BigQuery

Job description

Lidl GB is seeking a Business Intelligence Engineer on a 23‑month fixed‑term contract in London. You will partner with the Controlling team to build trusted data layers and scalable data products that power reporting and insights across the business.

The role requires expert SQL and Python, hands-on cloud data warehousing (Snowflake, BigQuery), and strong stakeholder management. You will modernise legacy processes, ensure data quality, and drive adoption of data solutions in a hybrid environment.