Principal Data & BI Engineer

Datatech Analytics; Stanford Dingley; On-site; GBP 90,000 - 130,000; Full time

Job summary

Datatech Analytics is seeking a Principal BI Engineer to lead the transition from a SQL Server-led setup to a scalable Azure Databricks-based data platform. You will own the end-to-end BI lifecycle, collaborating with stakeholders to define requirements and deliver production-grade solutions.

Ideal candidates bring advanced Python, PySpark and SQL skills, strong Power BI and data-modelling expertise, and a track record of delivering complex BI products across marketing, sales, and operations

Qualifications

• Design and build production-grade pipelines using Azure Databricks, Python, PySpark and SQL.
• Develop scalable Lakehouse architecture using Delta Lake and Unity Catalog.
• Build data and BI products from scratch and own them through to implementation.
• Connect marketing, sales and operational data to create a complete view of performance.
• Establish consistent KPI definitions and a trusted version of the truth.
• Influence senior stakeholders and raise engineering standards across the team.
• Use AI tools such as Claude and OpenRouter to support development, code review and documentation.
• Strong production experience with Azure Databricks.
• Advanced Python, PySpark and SQL skills.
• Advanced Power BI, DAX and data-modelling experience.
• Experience building and owning complex data or BI solutions end to end.
• Confidence translating ambiguous requirements into reliable, maintainable products.
• Strong domain experience in either performance marketing analytics or contact-centre operations, with an understanding of the data and KPIs that drive commercial performance.
• Microsoft Fabric experience would be a bonus.

Responsibilities

• Design and build production-grade pipelines using Azure Databricks, Python, PySpark and SQL.
• Develop scalable Lakehouse architecture using Delta Lake and Unity Catalog.
• Build data and BI products from scratch and own them through to implementation.
• Connect marketing, sales and operational data to create a complete view of performance.
• Establish consistent KPI definitions and a trusted version of the truth.
• Influence senior stakeholders and help raise engineering standards across the team.
• Use AI tools such as Claude and OpenRouter to support development, code review and documentation.
• Strong production experience with Azure Databricks.
• Advanced Python, PySpark and SQL skills.
• Advanced Power BI, DAX and data-modelling experience.
• Experience building and owning complex data or BI solutions end to end.
• Confidence translating ambiguous requirements into reliable, maintainable products.
• Strong domain experience in either performance marketing analytics or contact-centre operations, with an understanding of the data and KPIs that drive commercial performance.
• Microsoft Fabric experience would be a bonus.

Skills

Stakeholder engagement

Requirements gathering

Data modelling

Problem solving

Communication

Tools

Azure Databricks

Python

PySpark

SQL

Power BI

DAX

Delta Lake

Unity Catalog

Microsoft Fabric

Claude

OpenRouter

Job description

A fast-growing global organisation is looking for an experienced Principal BI Engineer to play a key role in its transition from a SQL Server-led environment to a modern, scalable data platform built around Azure Databricks and Python.

This is not a traditional reporting role - You'll work across the full data and BI lifecycle, owning complex solutions from initial stakeholder engagement and requirements gathering through to pipeline development, data modelling, semantic layers and Power BI delivery.

You’ll have the opportunity to:

• Design and build production-grade pipelines using Azure Databricks, Python, PySpark and SQL
• Develop scalable Lakehouse architecture using Delta Lake and Unity Catalog
• Build data and BI products from scratch and own them through to implementation
• Connect marketing, sales and operational data to create a complete view of performance
• Establish consistent KPI definitions and a trusted version of the truth
• Influence senior stakeholders and help raise engineering standards across the team
• Use AI tools such as Claude and OpenRouter to support development, code review and documentation
• Strong production experience with Azure Databricks
• Advanced Python, PySpark and SQL skills
• Advanced Power BI, DAX and data-modelling experience
• Experience building and owning complex data or BI solutions end to end
• Confidence translating ambiguous requirements into reliable, maintainable products
• Strong domain experience in either performance marketing analytics or contact-centre operations, with an understanding of the data and KPIs that drive commercial performance
• Microsoft Fabric experience would be a bonus