Data Engineering Lead, VP

Natwest Digitalx; Bengaluru; Presencial; INR 3.500.000 - 7.000.000; Jornada completa

Descripción de la vacante

Natwest Digitalx is seeking a Data Engineering Lead at vice president level to join our permanent feature team in Bengaluru. Youll design, build, test and implement data engineering solutions across the platform, driving the lifecycle from concept to production.

Youll lead a team of five Data Engineers, apply Agile methods, and collaborate with principal engineers, architects and stakeholders to deliver scalable, automated data architectures using Python, Spark, Airflow and dbt on Azure.

Formación

• Leading and line managing a team of Data Engineers.
• Experience leading scalable, automated data solutions.
• Strong SQL, data modelling, Python pipelines and Airflow/dbt orchestration.
• Experience designing cloud-based data solutions (Azure).

Responsabilidades

• Develop and enhance data engineering solutions across the platform.
• Lead and align a team of 5 Data Engineers.
• Apply Agile methods to backlog development.
• Design and implement automated build, test and deployment patterns.
• Collaborate with business, data teams and stakeholders to deliver pragmatic solutions.

Conocimientos

Data engineering

Leadership

Python

SQL

Data modelling

Stakeholder management

Agile methodologies

Herramientas

Airflow

dbt

Spark

PySpark

Azure

Descripción del empleo

Join us as a Software Engineer

Job Summary

• This is an opportunity for a technically minded individual to join us as a Data Engineering Lead
• Youll be designing, producing, testing and implementing data engineering solutions, working across the lifecycle of the system
• Hone your existing data engineering skills and advance your career in this critical role
• We're offering this role at vice president level

What you'll do

Working in a permanent feature team, youll be developing knowledge of aspects of the associated platform across the disciplines of business, applications, data and infrastructure. Youll also be liaising with principal engineers, architects in the domain and other key stakeholders to understand how the platform works and how it supports business objectives.

You'll also be:

• Applying Agile methods to the development of data engineering solutions on the backlog
• Producing resilient and long-lived solutions and acting flexibly to cope with future needs
• Delivering intentional architecture and formulating emergent design through innovative ideas, experimentation and prototyping
• Designing and developing solutions with a focus on the automation of build, test and deployment activities, using executable patterns
• Leading and line managing a team of 5 Data Engineers aligning to data engineering best practices

The skills you'll need

We're looking for someone with strong full stack experience in data engineering design and implementation, including being able to exploit programming languages to solve complex problems. You'll also need to be capable of complex requirements analysis capture and validation against and with business and systems requirements, coupled with leadership and people management skills

Additionally, you'll demonstrate:

• Experience of leading the implementation of best practice, especially around scalability, automation, virtualisation, optimisation, availability and performance
• Strong proficiency in relational databases, advanced SQL, and robust data modelling, database optimisation, Python pipelines, Airflow orchestration, and dbt transformation
• Experience designing, building, and operating cloudbased data solutions (Azure preferred)
• Extensive experience working with scalable batch and streaming architectures using distributed data processing frameworks such as Spark and PySpark
• Sound collaboration skills with the ability to work with business and data teams to produce pragmatic solutions that work for the business
• Experience of information security policies and data governance practices within the financial sector
• Strong stakeholder management skills and communication skills with the ability to communicate complex technical concepts in a simple way
• Experience of leading and line managing data engineers

Hours

45