Lead Data Engineer: Databricks Lakehouse Architect (London)

Forsyth Barnes; Greater London; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

Forsyth Barnes is searching for a Lead Data Engineer in London to design and deliver data solutions for financial institutions. You will lead the end-to-end development of scalable data pipelines using Databricks and AWS technologies. The role requires strong experience in Databricks, PySpark, and knowledge of cloud data architecture. A hands-on technical leader is sought who excels in mentoring others and balancing technical excellence with delivery timelines. The position involves working onsite part-time and offers a minimum 6-month contract.

Qualifications

• Strong experience as a Senior or Lead Data Engineer.
• Expertise in Databricks, PySpark / Spark, SQL, and Python.
• Proven experience with large-scale data pipelines in production.

Responsibilities

• Own the end-to-end design and build of scalable data pipelines.
• Define and implement lakehouse architecture standards.
• Design secure data ingestion frameworks.

Skills

Databricks

PySpark

SQL

Python

AWS

Airflow

Data Governance

Tools

Terraform

CloudFormation

Job description

Forsyth Barnes is searching for a Lead Data Engineer in London to design and deliver data solutions for financial institutions. You will lead the end-to-end development of scalable data pipelines using Databricks and AWS technologies. The role requires strong experience in Databricks, PySpark, and knowledge of cloud data architecture. A hands-on technical leader is sought who excels in mentoring others and balancing technical excellence with delivery timelines. The position involves working onsite part-time and offers a minimum 6-month contract.