Data Engineering Lead, VP

NatWest Group; Bengaluru; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

NatWest Group in Bengaluru, India, seeks a Data Engineering Lead at vice president level to design, build and implement scalable data platforms, working with principal engineers and architects to align data solutions with business goals.

You will lead a team of 5 data engineers, apply Agile methods, deliver resilient architectures, and drive automation of build, test and deployment. Focus on cloud-based data solutions and modern batch/streaming processing.

Qualifications

• Strong full stack experience in data engineering design and implementation.
• Ability to exploit programming languages to solve complex problems.
• Capability to perform complex requirements analysis with business and systems teams.

Responsibilities

• Develop knowledge of platform across business, applications, data and infrastructure disciplines.
• Liaise with principal engineers and architects to align platform with business objectives.
• Apply Agile methods to develop data engineering solutions on the backlog.
• Lead and line-manage a team of 5 Data Engineers and promote best practices.

Skills

Data engineering

Leadership

Python pipelines

SQL

Airflow

dbt transformation

Spark/PySpark

Cloud data solutions

Stakeholder management

Tools

Azure

Airflow (orchestration)

dbt

Spark

Job description

Join us as a Software Engineer

• This is an opportunity for a technically minded individual to join us as a Data Engineering Lead
• You'll be designing, producing, testing and implementing data engineering solutions, working across the lifecycle of the system
• Hone your existing data engineering skills and advance your career in this critical role
• We're offering this role at vice president level

What you'll do

Working in a permanent feature team, you'll be developing knowledge of aspects of the associated platform across the disciplines of business, applications, data and infrastructure. You'll also be liaising with principal engineers, architects in the domain and other key stakeholders to understand how the platform works and how it supports business objectives.

You'll also be:

• Applying Agile methods to the development of data engineering solutions on the backlog
• Producing resilient and long-lived solutions and acting flexibly to cope with future needs
• Delivering intentional architecture and formulating emergent design through innovative ideas, experimentation and prototyping
• Designing and developing solutions with a focus on the automation of build, test and deployment activities, using executable patterns
• Leading and line managing a team of 5 Data Engineers aligning to data engineering best practices

The skills you'll need

We're looking for someone with strong full stack experience in data engineering design and implementation, including being able to exploit programming languages to solve complex problems. You'll also need to be capable of complex requirements analysis capture and validation against and with business and systems requirements, coupled with leadership and people management skills

Additionally, you'll demonstrate:

• Experience of leading the implementation of best practice, especially around scalability, automation, virtualisation, optimisation, availability and performance
• Strong proficiency in relational databases, advanced SQL, and robust data modelling, database optimisation, Python pipelines, Airflow orchestration, and dbt transformation
• Experience designing, building, and operating cloud-based data solutions (Azure preferred)
• Extensive experience working with scalable batch and streaming architectures using distributed data processing frameworks such as Spark and PySpark
• Sound collaboration skills with the ability to work with business and data teams to produce pragmatic solutions that work for the business
• Experience of information security policies and data governance practices within the financial sector
• Strong stakeholder management skills and communication skills with the ability to communicate complex technical concepts in a simple way
• Experience of leading and line managing data engineers