Lead Data Engineer (Azure)

OpenSource; Remote; Confidential; Full time

Job summary

A leading SaaS provider in the United Kingdom is seeking a Lead Data Engineer to oversee the construction and management of their data platform. This hands-on role involves mentoring a team of data engineers, building robust data pipelines, and ensuring the quality and reliability of data. The ideal candidate will have strong Databricks experience, advanced Python and SQL skills, and a background in cloud platforms like Azure. The position offers a competitive salary and a 10% bonus.

Benefits

Competitive salary

10% Bonus

Qualifications

• Experience leading or mentoring data engineers in a SaaS or product-led environment.
• Strong hands-on experience with Databricks, including Spark and Delta Lake.
• Advanced Python and SQL skills for data engineering and analytics use cases.

Responsibilities

• Leading a small team of data engineers and analysts, setting technical direction.
• Owning the end-to-end data lifecycle, from ingestion through to analytics delivery.
• Building and operating robust data pipelines using Databricks, Spark, and Delta Lake.

Skills

Leadership in data engineering

Databricks

Strong communication skills

Python

SQL

Cloud platforms (Azure)

Tools

Data visualization tools (Power BI, Tableau)

Data orchestration tools (Airflow, Dagster)

Infrastructure as Code tools (Terraform)

Job description

We’re partnering with a fast-growing SaaS business that’s investing heavily in its data and analytics platform. They’re looking for a Lead Data Engineer to play a key role in shaping how data is built, trusted, and used across the organisation.

This is a hands-on leadership role, ideal for someone who enjoys remaining close to the technology while guiding a small team and influencing platform architecture. You’ll have real ownership, the chance to set standards, and the opportunity to build a modern data platform that supports both internal teams and customer-facing use cases.

Tasks

• Leading, mentoring, and developing a small team of data engineers and analysts, setting technical direction and best practices
• Owning the end-to-end data lifecycle, from ingestion through to analytics delivery
• Building and operating robust data pipelines using Databricks, Spark, and Delta Lake
• Working closely with product, engineering, and other stakeholders to deliver the data roadmap
• Creating trusted datasets, dashboards, and APIs for internal and external customers
• Improving data quality, reliability, governance, and observability across the platform
• Supporting and enhancing CI/CD pipelines, automated testing, and cloud operations to ensure scalability and resilience

Requirements

• Experience leading or mentoring data engineers in a SaaS or product-led environment
• Strong hands‑on experience with Databricks, including Spark and Delta Lake
• Advanced Python and SQL skills for data engineering and analytics use cases
• Solid experience working with a major cloud platform, with Azure strongly preferred
• Strong communication skills and the ability to collaborate effectively across teams

Nice to have

• Experience with data orchestration tools such as Airflow or Dagster
• Familiarity with Infrastructure as Code tools (e.g. Terraform)
• Exposure to BI and data visualisation tools such as Power BI or Tableau

Benefits

Competitive salary + 10% Bonus.

We look forward to reviewing your application!