Lead Data Engineer (Azure)

OpenSource; Greater London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A fast-growing SaaS company in Greater London is seeking a Lead Data Engineer to shape the data architecture and manage a team. This hands-on role involves overseeing the entire data lifecycle, mentoring team members, and developing data pipelines using Databricks, Spark, and Delta Lake. Ideal candidates will have strong Python and SQL skills and experience with cloud platforms, ideally Azure. The position offers a competitive salary and a bonus of 10%.

Benefits

Competitive salary

10% Bonus

Qualifications

• Experience leading or mentoring data engineers in a SaaS environment.
• Strong hands-on experience with Databricks, including Spark and Delta Lake.
• Advanced Python and SQL skills for data engineering use cases.

Responsibilities

• Leading, mentoring, and developing a small team of data engineers.
• Owning the end-to-end data lifecycle from ingestion to analytics delivery.
• Building robust data pipelines using Databricks, Spark, and Delta Lake.

Skills

Leading and mentoring teams

Databricks expertise

Advanced Python

SQL skills

Cloud platform experience

Strong communication

Tools

Databricks

Airflow

Terraform

Power BI

Tableau

Job description

We’re partnering with a fast-growing SaaS business that’s investing heavily in its data and analytics platform. They’re looking for a Lead Data Engineer to play a key role in shaping how data is built, trusted, and used across the organisation.

This is a hands‑on leadership role, ideal for someone who enjoys remaining close to the technology while guiding a small team and influencing platform architecture. You’ll have real ownership, the chance to set standards, and the opportunity to build a modern data platform that supports both internal teams and customer-facing use cases.

Tasks

• Leading, mentoring, and developing a small team of data engineers and analysts, setting technical direction and best practices
• Owning the end-to-end data lifecycle, from ingestion through to analytics delivery
• Building and operating robust data pipelines using Databricks, Spark, and Delta Lake
• Working closely with product, engineering, and other stakeholders to deliver the data roadmap
• Creating trusted datasets, dashboards, and APIs for internal and external customers
• Improving data quality, reliability, governance, and observability across the platform
• Supporting and enhancing CI/CD pipelines, automated testing, and cloud operations to ensure scalability and resilience

Requirements

• Experience leading or mentoring data engineers in a SaaS or product‑led environment
• Strong hands‑on experience with Databricks, including Spark and Delta Lake
• Advanced Python and SQL skills for data engineering and analytics use cases
• Solid experience working with a major cloud platform, with Azure strongly preferred
• Strong communication skills and the ability to collaborate effectively across teams

Nice to have

• Experience with data orchestration tools such as Airflow or Dagster
• Familiarity with Infrastructure as Code tools (e.g. Terraform)
• Exposure to BI and data visualisation tools such as Power BI or Tableau

Benefits

Competitive salary + 10% Bonus.

We look forward to reviewing your application!