Databricks Lead Engineer - Data Pipelines & Lakehouse

NTT; Greater London; On-site; GBP 70,000 - 100,000; Full time

Job summary

NTT is seeking a Senior Data Engineer to lead and deliver scalable Databricks-based data pipelines across cloud platforms. You will design, implement and optimise lakehouse architectures, drive governance and collaborate with analytics leadership to meet client requirements.

The role requires 5–8 years in data engineering with 3+ years on Databricks, strong Python/SQL skills, and cloud experience. Hybrid working in Greater London is common for client engagements.

Qualifications

• Experience leading or mentoring teams of engineers to deliver high-quality scalable data solutions.
• Hands-on expertise across the data lifecycle: ingestion, transformation, modelling, governance, and consumption.
• Strong problem-solving, analytical, and communication skills.
• Proven experience in data engineering and pipeline development on Databricks and cloud-native platforms.
• Exposure to AI/ML workloads desirable.

Responsibilities

• Lead data engineering projects delivering high-performing, scalable data pipelines.
• Collaborate with client stakeholders up to Head of Data Engineering and Analytics leadership.
• Mentor teams of engineers to ensure best practices and quality.

Skills

Databricks

Spark

Python

SQL

Delta Lake

Data Modelling

Data Warehousing

CI/CD

GitHub/Bitbucket

Cloud Platforms

DBT

Matillion

Talend

Pyspark/Scala

ML/AI workloads

Tools

Unity Catalog

MLflow

Job description

NTT is seeking a Senior Data Engineer to lead and deliver scalable Databricks-based data pipelines across cloud platforms. You will design, implement and optimise lakehouse architectures, drive governance and collaborate with analytics leadership to meet client requirements.

The role requires 5–8 years in data engineering with 3+ years on Databricks, strong Python/SQL skills, and cloud experience. Hybrid working in Greater London is common for client engagements.