Data Engineer Python, PySpark & AWS, AVP

Natwest Digitalx

Bengaluru

On-site

INR 1,800,000 - 2,800,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Natwest Digitalx in Bengaluru is seeking a data engineer to build digital-first customer experiences, secure data, and drive insights through data pipelines, modelling, and ETL design. The role emphasizes streaming data ingestion and a strong focus on cost-aware architecture.

The daily work involves understanding data structures, delivering transformation solutions, and extracting data for analysts and data scientists while collaborating with product teams to enable scalable, secure data

Qualifications

  • Deep knowledge of data usage and dependencies with enterprise teams and end customers.
  • Experience extracting value and features from large-scale data.
  • Experience with ETL technical design, data quality testing, cleansing and monitoring, data sourcing and analysis.
  • Experience with data warehousing and data modelling, including star/snowflake schemas.

Responsibilities

  • Develop comprehensive knowledge of data structures and metrics; advocate for change for product development.
  • Provide transformation solutions and carry out complex data extractions.
  • Understand data platform cost levels to build cost-effective, strategic solutions.
  • Source new data using appropriate tooling and integrate into the overall solution for customers.
  • Drive customer value by solving complex business problems with reusable tools; contribute to data engineering community.
  • Lead on planning and design of complex products; mentor colleagues.

Skills

Python
PySpark
ETL design
Data modelling
Data warehousing
PostgreSQL
AWS
CI/CD

Tools

Kiro
Copilot

Job description

Job Summary

Join us as a Data Engineer

  • Were looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secure
  • Day-to-day, youll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through insights
  • If youre ready for a new challenge, and want to bring a competitive edge to your career profile by delivering streaming data ingestions, this could be the role for you
  • We're offering this role at associate vice president level

What youll do

Your daily responsibilities will include you developing a comprehensive knowledge of our data structures and metrics, advocating for change when needed for product development. Youll also provide transformation solutions and carry out complex data-extractions.

Well expect you to develop a clear understanding of data platform cost levels to build cost-effective and strategic solutions. Youll also source new data by using the most appropriate tooling before integrating it into the overall solution to deliver it to our customers.

Youll also be responsible for:

  • Driving customer value by understanding complex business problems and requirements to correctly apply the most appropriate and reusable tools to build data solutions
  • Participating in the data engineering community to deliver opportunities to support our strategic direction
  • Carrying out complex data engineering tasks to build a scalable data architecture and the transformation of data to make it usable to analysts and data scientists
  • Building advanced automation of data engineering pipelines through the removal of manual stages
  • Leading on the planning and design of complex products and providing guidance to colleagues and the wider team when required

The skills youll need

To be successful in this role, youll have an understanding of data usage and dependencies with wider teams and the end customer. Youll also have experience of extracting value and features from large scale data.

Well expect you to have experience of ETL technical design, data quality testing, cleansing and monitoring, data sourcing, exploration and analysis, and data warehousing and data modelling capabilities.

Youll also need:

  • At least eight years of experience building and supporting enterprise-scale data pipelines and analytics solutions using advanced Python and PySpark for large-scale batch and real-time processing
  • Strong experience in data warehousing, including dimensional modelling, star and snowflake schemas, fact and dimension design, SCD, ETL/ELT frameworks, data lake and data warehouse architectures, data quality and governance
  • Strong expertise in PostgreSQL database design, optimisation and query tuning, along with AWS services including S3, Glue, EMR, Lambda, RDS, ECS/EKS, CloudWatch, IAM and API Gateway
  • Experience translating business requirements into HLD/LLD documents and designing secure, scalable and resilient integration patterns for enterprise applications and data platforms
  • Experience with CI/CD pipelines, multi-environment release management, automated testing and production troubleshooting with root-cause analysis
  • Strong Agile delivery experience with Product Owners, Architects and business stakeholders, including Jira, sprint planning, estimation, backlog grooming and retrospectives, with exposure to AI-assisted development tools such as Kiro and Copilot and mentoring engineers as an advantage

Hours

45

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer – Python, PySpark & AWS, AVP
Data Engineer – Python, PySpark & AWS, AVP

NatWest Group • Bengaluru

On-site
INR 5,000,000 - 9,000,000
Data Engineer, AVP
Data Engineer, AVP

NatWest Group • Bengaluru

On-site
INR 2,000,000 - 4,000,000
Data Engineer AVP
Data Engineer AVP

RBS • Gurugram District

On-site
INR 3,500,000 - 5,000,000
Data Engineer, Vp
Data Engineer, Vp

NatWest Group • Bengaluru

On-site
INR 3,500,000 - 5,500,000
Data Engineer - ETL
Data Engineer - ETL

Barclays Capital • Bengaluru

On-site
INR 700,000 - 1,000,000
Senior AWS Data Engineer
Senior AWS Data Engineer

Durapid Technologies Pvt Ltd • Bengaluru

On-site
INR 2,500,000 - 4,500,000
Lead Python Developer, AVP
Lead Python Developer, AVP

NatWest Group • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Data Engineer
Data Engineer

Sunday Labs Tech, Inc. • Mumbai

On-site
INR 1,500,000 - 3,000,000
Data Engineer
Data Engineer

Indium Software • Bengaluru

On-site
INR 900,000 - 1,500,000
Data Engineer
Data Engineer

Grid Dynamics • Bengaluru

Hybrid
INR 900,000 - 1,400,000