Databricks Data Engineer - NTT DATA

OpenTalent; Greater London; On-site; GBP 70,000 - 110,000; Full time

Job summary

NTT DATA is seeking a highly skilled Databricks Data Engineer to join our Data & AI practice. You will design and implement robust ETL/ELT pipelines, optimize Lakehouse architectures, and enable advanced analytics and AI use cases on Databricks.

In this client-facing role, you will collaborate across teams to deliver scalable data solutions, ensure governance and security, and mentor engineers while driving best practices.

Qualifications

• Proven experience in data engineering and pipeline development on Databricks and cloud-native platforms.
• Hands-on expertise across the data lifecycle: ingestion, transformation, modelling, governance, and consumption.
• Strong SQL and Python skills for data manipulation and automation.
• Experience leading or mentoring teams of engineers to deliver scalable data solutions.

Responsibilities

• Client Engagement & Delivery.
• Data Pipeline Development (Batch and Streaming).
• Databricks & Lakehouse Architectures.
• Data Modelling & Optimisation (Delta Lake, Medallion architecture).
• Collaboration & Best Practices.
• Quality, Governance & Security.

Skills

Databricks Platform

Python

SQL

Spark

Data Modeling

Cloud Platforms

Tools

DBT

Matillion

Talend

Delta Lake

Unity Catalog

MLflow

Job description

Make an impact with NTT DATA

Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.

Your day at NTT DATA

We are seeking a highly skilled Databricks Data Engineer to join our Data & AI practice. The successful candidate will have deep expertise in building scalable data pipelines, optimizing Lakehouse architectures and enabling advanced analytics and AI use cases on the Databricks platform. This role is critical in building and optimizing modern data ecosystems that enable data-driven decision making, advanced analytics, and AI capabilities for our clients.

As a trusted practitioner, you will design and implement robust ETL/ELT workflows, integrate real-time and batch data sources, and enable secure, well-governed data products and pipelines. You will thrive in a collaborative, client-facing environment, with a passion for solving complex data challenges, driving innovation and ensuring the seamless delivery of data solutions.

• Client Engagement & Delivery
• Data Pipeline Development (Batch and Streaming)
• Databricks & Lakehouse Architectures
• Data Modelling & Optimisation (Delta Lake, Medallion architecture)
• Collaboration & Best Practices
• Quality, Governance & Security
• Solution Architects
• Data Engineers, Developers, ML Engineers, and Analysts
• Client stakeholders up to Head of Data Engineering, Chief Data Architect, and Analytics leadership
• Proven experience in data engineering and pipeline development on Databricks and cloud-native platforms.
• Strong consulting values with ability to collaborate effectively in client-facing environments.
• Hands-on expertise across the data lifecycle: ingestion, transformation, modelling, governance, and consumption.
• Strong problem-solving, analytical, and communication skills.
• Experience leading or mentoring teams of engineers to deliver high-quality scalable data solutions.
• Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow).
• Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent.
• Strong SQL and Python (or equivalent language) skills for data manipulation and automation.
• Hands-on experience with cloud platforms (AWS, Azure, GCP).