Databricks Lead Engineer: Data Lakehouse & Pipelines

nttlimited; Greater London; On-site; GBP 90,000 - 120,000; Full time

Job summary

NTT DATA is seeking an experienced data engineering lead to design and deliver scalable data pipelines and lakehouse architectures for client engagements in London. You will lead and mentor engineers, drive best practices, and ensure governance and security across data platforms.

The role requires deep Databricks expertise, strong consulting acumen, and hands-on work across ingestion, transformation, and consumption in cloud environments.

Qualifications

• 5–8 years in data engineering, data warehousing, or data architecture roles, with at least 3+ years with Databricks.
• University degree required.
• Databricks certification (Data Engineer Professional) highly desirable.
• Experience with cloud platforms and data modelling methodologies.

Responsibilities

• Client Engagement & Delivery.
• Data Pipeline Development (Batch and Streaming).
• Databricks & Lakehouse Architectures.
• Data Modelling & Optimisation (Delta Lake, Medallion architecture).
• Collaboration & Best Practices.
• Quality, Governance & Security.

Skills

Data engineering

Consulting skills

Data lifecycle

Problem solving

Technical leadership

Education

University degree

BSc/MSc in CS/Data Engineering

Databricks Certification desirable

Tools

Databricks (Spark, PySpark, Scala)

Delta Lake

Unity Catalog

MLflow

DBT

Matillion

Talend

GitHub

CI/CD pipelines

AWS

Azure

GCP

Job description

NTT DATA is seeking an experienced data engineering lead to design and deliver scalable data pipelines and lakehouse architectures for client engagements in London. You will lead and mentor engineers, drive best practices, and ensure governance and security across data platforms.

The role requires deep Databricks expertise, strong consulting acumen, and hands-on work across ingestion, transformation, and consumption in cloud environments.