Senior Data Engineer, Director

National Westminster Bank PLC; Chennai District; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

National Westminster Bank PLC in Chennai invites a Senior Data Engineer to lead design, build and maintain scalable data pipelines and architectures, including data lakes and data warehouses, using Apache Spark, Spark Streaming, and AWS to deliver analytics-ready datasets.

You will mentor junior engineers, collaborate with data scientists and analysts, ensure data quality and security, and advance real-time processing and AI-enabled data solutions across platforms.

Qualifications

• 12+ years of professional experience as a Data Engineer or similar role.
• Strong expertise in Apache Spark, Spark Streaming, and performance optimization.
• Experience with Scala, Python, and real-time data processing.

Responsibilities

• Design, build and maintain scalable data pipelines and architectures.
• Develop data lakes, data warehouses, and databases to support analytics.
• Build real-time data streaming apps using Spark Streaming and Flink; tune performance.
• Collaborate with data scientists and analysts to deliver clean, reliable datasets.
• Mentor junior engineers and drive data governance, security, and compliance.

Skills

Apache Spark

Spark Streaming

Scala

Python

AI concepts in data engineering

FastAPI

Education

Bachelor's or Master's in Computer Science, Engineering, Information Systems, or related field

Tools

AWS (EMR, Kinesis, DynamoDB, Athena, QuickSight)

Parquet

Apache Iceberg

Docker

Kubernetes

SQL

Hive

Job description

Closing date for applications: 24/08/2026

Location Chennai, India

Job typePermanent | Contract typeFull Time

Join our digital revolution in NatWest Digital X

In everything we do, we work to one aim. To make digital experiences which are effortless and secure.

So we organise ourselves around three principles: engineer, protect, and operate. We engineer simple solutions, we protect our customers, and we operate smarter.

Job description

This role is based in India and as such all normal working days must be carried out in India.

Join us as a Senior Data Engineer

Well look to you to drive the build of effortless, digital-first customer experiences as you simplify our bank while keeping our data safe and secure

Day-to-day, youll develop innovative, data-driven solutions through data pipeline modelling and ETL design, inspiring to be commercially successful through insights

This is your opportunity to explore your leadership potential while bringing a competitive edge to your career profile by solving problems and creating smarter solutions

We're offering this role at director level

What youll do

In this role, youll design, build and maintaining scalable data pipelines and architectures. The ideal candidate will have strong expertise in handling large data sets, optimising data flows, and collaborating closely with data scientists, analysts, and other engineering teams to enable data-driven decision-making.

Well look to you to design, develop, and maintain scalable data pipelines and ETL processes to support analytics and reporting requirements, while building and optimizing data architectures including data lakes, data warehouses, and databases. You'll develop and support real-time data streaming applications using Apache Spark Streaming and Apache Flink, perform Spark performance tuning for large-scale data processing, and collaborate closely with data scientists and analysts to deliver clean, reliable, and high-quality datasets.

Youll also be responsible for:

• Driving customer value by understanding complex business problems and requirements to correctly apply the most appropriate and reusable tools to gather and build data solutions
• Ensureing data quality, integrity, and security across all data platforms.
• Implementing best practices for data governance and compliance.
• Monitoring and troubleshooting data pipeline performance and resolve data-related issues proactively.
• Evaluating and integrating new data technologies and tools to enhance data processing capabilities, with a focus on AI tools and concepts.
• Collaborating with cross-functional teams to support data-driven initiatives.
• Mentoring and guiding junior data engineers and team members.

The skills youll need

Were looking for someone with strong communication skills and the ability to proactively engage and manage a wide range of stakeholders. You'll need at least twelve years of professional experience as a Data Engineer or in a similar role, with strong expertise in Apache Spark including Spark Streaming and performance optimization, Scala, Python, and Apache Flink for real-time data processing. You'need expertise in AI concepts and tools within data engineering workflows, build high-performance data APIs using FastAPI, and working extensively with AWS services such as EMR, Kinesis, DynamoDB, Athena, and QuickSight.

You'll need hands-on experience with data lake technologies and formats including Parquet and Apache Iceberg, containerization platforms such as Docker and Podman, and relational databases including PostgreSQL and Hive, supported by strong SQL skills. You’ll also contribute to machine learning pipeline integration, ensure compliance with GDPR and other data privacy regulations, and hold a Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related field.

Youll also need:

• Expertise in ETL tools and frameworks and data pipeline orchestration.
• Strong understanding of cloud data platforms and services.
• Knowledge of data modelling, schema design, and data architecture principles.
• Familiarity with data security standards and compliance requirements.
• Experience with DevOps, CI/CD pipelines, and container orchestration like Kubernetes
• An understanding of modern code development practices

Welcome to our Chennai hub

Nestled in the heart of One India Bulls Park, our hub in Kosmo One, Tower A, is one of Ambatturs first skyscraper spanning 420,000 sq. ft.

Key facts:

• Surrounded by 10 acres
• Space for 3,600 colleagues
• Opened in 2009 .