Lead Data Engineer

Oliver James

Greater London

Hybrid

GBP 111,000 - 166,000

Full time

3 days ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Oliver James Group partners with a major international travel business to hire a Lead Data Engineer to run a team of 5-7 engineers building its Databricks data platform and data products. The role is split evenly between leadership and hands-on engineering, and you’ll stay hands-on in code, design and review while coaching the team and acting as the main technical contact for business areas.

The position is hybrid with one day in the office per week in London or Brussels, offering a competitive

Qualifications

  • 7+ years in data engineering with at least 2 years leading/mentoring engineers.
  • Hands-on experience with Databricks and Spark (Unity Catalog, Delta Lake, Lakeflow/DLT).
  • Strong Python and SQL skills.
  • Experience building data as a product and data templates/CI/CD.

Responsibilities

  • Lead, coach and develop a team of data engineers (5-7) and align priorities with product owners.
  • Set and enforce coding, testing, and CI/CD standards.
  • Build reusable templates and shared libraries for new data products.
  • Make data AI-ready with metadata and semantic definitions.
  • Review work of analytics engineers and ensure alignment with business needs.

Skills

Databricks
Spark
Python
SQL
Data modelling
CI/CD
Leadership

Tools

Databricks Genie
Delta Lake

Job description

Lead Data Engineer - Databricks Contract: 12 months, renewable Location: Hybrid, 1 day a week in the office (London or Brussels) Rate: Competitive day rate, depending on experience

A major international travel business is looking for a Lead Data Engineer to run a team of 5-7 engineers building its Databricks data platform and data products.

The role is split evenly: half leading people, half leading the engineering. You'll stay hands-on in code, design and review while coaching the team and acting as the main technical contact for business areas such as Commercial, Operations and Customer.

What you'll do
  • Lead, coach and develop a team of data engineers, and work with the Engineering Manager, Scrum Master and product owners on priorities and delivery
  • Set and enforce coding, testing, review and CI/CD standards
  • Build reusable project templates (Databricks Asset Bundles), shared libraries and CI/CD pipelines that every new data product follows
  • Make data AI-ready: rich metadata, semantic definitions and curated Genie spaces
  • Set standards for, and review the work of, analytics engineers in the business
What you'll need
  • 7+ years in data engineering, including at least 2 years leading or mentoring engineers
  • Deep hands-on experience with Databricks and Spark (Unity Catalog, Delta Lake, Lakeflow / DLT), plus strong Python and SQL
  • Strong data modelling skills and experience building data as a product
  • A track record of building templates, libraries or CI/CD that other engineers adopted
  • Working knowledge of AI data agents such as Databricks Genie
  • Clear communication with both technical and business stakeholders

Nice to have: dbt, Azure, FinOps on Databricks, data contracts, AI agent architecture (LLM, RAG, MCP), and experience leading teams across the UK and Europe. French is an advantage but not required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer (Databricks) - Build Data as a Product
Lead Data Engineer (Databricks) - Build Data as a Product

Oliver James • Greater London

Hybrid
GBP 111,000 - 166,000
Lead Databricks Engineer
Lead Databricks Engineer

Sentior, Ltd. • Greater London

Hybrid
GBP 90,000 - 130,000
Lead Data Engineer
Lead Data Engineer

Forsyth Barnes • Greater London

Hybrid
GBP 70,000 - 90,000
Lead Data Engineer
Lead Data Engineer

Y-Axis • Huddersfield

Hybrid
GBP 68,000 - 83,000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

hireful • Greater London

Remote
GBP 77,000 - 94,000
Health insurance
Private pension scheme
Life assurance
+2
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

Hireful • City Of London

Remote
GBP 77,000 - 94,000
Health insurance
Bonus 10%
Lead Data Engineer (Azure/Databricks)
Lead Data Engineer (Azure/Databricks)

developrec • London

Hybrid
GBP 60,000 - 80,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Tenth Revolution Group • United Kingdom

Remote
GBP 90,000 - 130,000
Databricks Tech Lead: Data Platform & Architecture
Databricks Tech Lead: Data Platform & Architecture

Sentior, Ltd. • Greater London

Hybrid
GBP 90,000 - 130,000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

ISx4 Group • Belfast City District

Hybrid
GBP 70,000 - 100,000