Lead Databricks Engineer | Databricks Gold partner

Kubrick Group; Greater London; Hybrid; GBP 90,000 - 150,000; Full time

Benefits offered by this job

33 days leave

Pension matching 5%

Hybrid working

Flexible working

Cycle to work

Mental health support

Family leave

Employee discounts

Job summary

Kubrick Group is seeking a Lead Databricks Engineer to shape architecture, drive technical strategy, and deliver scalable Data & AI solutions for enterprise clients in a hybrid London setting.

You will stay hands-on while leading delivery teams, mentoring engineers, and partnering with Databricks Professional Services to deliver measurable business value.

Qualifications

• Strong experience delivering solutions on Databricks.
• Cloud experience across AWS, Azure or GCP.
• Advanced Python and SQL skills.
• Experience leading technical delivery teams within enterprise environments.
• The ability to influence both technical and business stakeholders.
• Experience mentoring engineers and driving engineering best practice.
• A mindset focused on quality, impact and continuous improvement.

Responsibilities

• Lead the end-to-end delivery of enterprise Databricks solutions.
• Design scalable architectures across data engineering, governance, analytics, and AI.
• Deliver modern Data & AI solutions including Unity Catalog, Databricks Apps, Genie, AI Agents, and platform modernization.
• Partner with Databricks Professional Services and client stakeholders to shape technical direction.
• Translate complex business challenges into production-ready solutions and deliver measurable outcomes.
• Mentor engineers and help raise engineering standards across the Databricks practice.
• Contribute to Kubrick's Databricks Centre of Excellence through knowledge sharing and technical leadership.

Skills

Databricks delivery

Cloud platforms

Python

SQL

Leadership

Mentoring

Stakeholder influence

Quality focus

Tools

Databricks

Job description

About Kubrick

Kubrick is an award-winning data & AI consultancy helping organizations design, build, and scale modern data platforms across financial services, healthcare, retail, energy, aviation, and the public sector.

About Kubrick

Kubrick is an award-winning data & AI consultancy helping organizations design, build, and scale modern data platforms across financial services, healthcare, retail, energy, aviation, and the public sector.
As a Databricks Gold Partner, we're trusted to deliver alongside Databricks Professional Services on complex enterprise programs. Our engineers work closely with Databricks Solution Architects and technical specialists to help organizations modernize data platforms, accelerate AI adoption, and solve complex business challenges.
We're also an Elite Snowflake AI Data Cloud Services Partner, and have partnerships with technology leaders including Microsoft and Collibra; giving you access to a wide range of opportunities.

The Opportunity

As a Lead Databricks Engineer, you'll help organizations solve complex technical challenges and deliver measurable outcomes by shaping architecture, influencing technical strategy, and designing scalable Data & AI solutions. Every client is at a different stage of their Databricks journey, from modernizing legacy platforms and strengthening governance with Unity Catalog to implementing AI Agents, Databricks Apps, and Genie-powered experiences.
You'll remain hands-on while leading delivery, mentoring engineers, and working alongside Databricks Professional Services on enterprise-scale engagements that deliver measurable business value.
If you're looking for a role where you can combine deep technical expertise with genuine influence, you'll feel at home here.

What We’re Looking For

We’re looking for curious, collaborative people who enjoy solving complex challenges, sharing knowledge and continuing to grow in a fast-evolving space.

You’ll bring:

• Strong experience delivering solutions on Databricks
• Cloud experience across AWS, Azure or GCP
• Advanced Python and SQL skills
• Experience leading technical delivery teams within enterprise environments
• The ability to influence both technical and business stakeholders
• Experience mentoring engineers and driving engineering best practice
• A mindset focused on quality, impact and continuous improvement

What You’ll Do

• Lead the end-to-end delivery of enterprise Databricks solutions.
• Design scalable architectures across data engineering, governance, analytics, and AI.
• Deliver modern Data & AI solutions including Unity Catalog, Databricks Apps, Genie, AI Agents, and platform modernization.
• Partner with Databricks Professional Services and client stakeholders to shape technical direction.
• Translate complex business challenges into production-ready solutions and deliver measurable outcomes.
• Mentor engineers and help raise engineering standards across the Databricks practice.
• Contribute to Kubrick's Databricks Centre of Excellence through knowledge sharing and technical leadership.

If you don't tick every box but think you'd thrive in this role then we'd still love to hear from you!

Additional Benefits

• 33 days annual leave including UK public holidays
• Pension matching up to 5%
• Hybrid working in our London office near St. Paul’s
• Flexible working options
• Cycle to work scheme
• Unlimited mental health support and GP access through Help@Hand
• Enhanced family leave and additional family support policies
• Financial wellbeing support and employee discounts

Diversity and inclusion

We’re committed to building a diverse and inclusive workplace where everyone can thrive.
We’re proud to have above-industry representation of women and non-binary individuals in tech, supported by a range of employee resource groups, inclusive policies, flexible working, and more.
If you require any adjustments during the application or interview process, please let us know - we’re here to support you.