Databricks Data Engineer — Lakehouse & AI Solutions

OpenTalent; Greater London; On-site; GBP 70,000 - 110,000; Full time

Job summary

NTT DATA is seeking a highly skilled Databricks Data Engineer to join our Data & AI practice. You will design and implement robust ETL/ELT pipelines, optimize Lakehouse architectures, and enable advanced analytics and AI use cases on Databricks.

In this client-facing role, you will collaborate across teams to deliver scalable data solutions, ensure governance and security, and mentor engineers while driving best practices.

Qualifications

• Proven experience in data engineering and pipeline development on Databricks and cloud-native platforms.
• Hands-on expertise across the data lifecycle: ingestion, transformation, modelling, governance, and consumption.
• Strong SQL and Python skills for data manipulation and automation.
• Experience leading or mentoring teams of engineers to deliver scalable data solutions.

Responsibilities

• Client Engagement & Delivery.
• Data Pipeline Development (Batch and Streaming).
• Databricks & Lakehouse Architectures.
• Data Modelling & Optimisation (Delta Lake, Medallion architecture).
• Collaboration & Best Practices.
• Quality, Governance & Security.

Skills

Databricks Platform

Python

SQL

Spark

Data Modeling

Cloud Platforms

Tools

DBT

Matillion

Talend

Delta Lake

Unity Catalog

MLflow

Job description

NTT DATA is seeking a highly skilled Databricks Data Engineer to join our Data & AI practice. You will design and implement robust ETL/ELT pipelines, optimize Lakehouse architectures, and enable advanced analytics and AI use cases on Databricks.

In this client-facing role, you will collaborate across teams to deliver scalable data solutions, ensure governance and security, and mentor engineers while driving best practices.