Group Manager- Data Engineering | Azure Databricks | Snowflake SQL | Team Management

WNS Global Services; Bengaluru; On-site; INR 1,800,000 - 2,600,000; Full time

Job summary

WNS Global Services, part of Capgemini, seeks a Data Engineering Lead with 8 to 12 years of experience to drive data pipelines for an enterprise finance data platform on Azure, Databricks and Snowflake. You will lead the data engineering team, own delivery from source systems to certified Gold data products, and set engineering standards across the team.

Experience in banking/financial services data and a proven track record of delivering cloud data platforms is required.

Qualifications

• 8 to 12 years in data engineering, with at least 3 years leading teams.
• Delivered at least one cloud data platform on Databricks or Snowflake into production.
• Experience on data programmes in banking or financial services.
• Degree in engineering or computer science.

Responsibilities

• Lead a team of data engineers building ingestion and transformation pipelines.
• Publish certified data products from Databricks to Snowflake for reporting and analysis.
• Tune pipeline performance and manage compute usage.
• Support production issues and handover to the support team.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

Unity Catalog

Snowflake SQL

Azure Data Factory

Python

SQL

Git & CI/CD

Azure DevOps

Team leadership

Education

Engineering or Computer Science degree

Tools

Informatica CDC

PowerCenter

API Management

Service Bus

Functions

Dataiku

Microsoft Purview

Job description

• Full-time

Company Description

WNS, part of Capgemini,is an Agentic AI-powered leader in intelligent operations and transformation, serving more than 700 clients across 10 industries, including Banking and Financial Services, Healthcare, Insurance, Shipping and Logistics, and Travel and Hospitality. We bring together deep domain excellence – WNS’ core differentiator – with AI-powered platforms and analytics to help businesses innovate, scale, adapt and build resilience in a world defined by disruption.
Our purpose is clear: to enable lasting business value by designing intelligent, human-led solutions that deliver sustainable outcomes and a differentiated impact. With three global headquarters across four continents, operations in 13 countries, 65 delivery centers and more than 66,000 employees, WNS combines scale, expertise and execution to create meaningful, measurable impact.

Why Join Us?

We promise our employees to experiencerole clarity, coaching and mentoring, professional development and structured career path through our 5 people promisesand keeping employee experience at the core. Experience the culture of Outperformance, engagement, celebration and enjoy wide variety ofbest in class benefits including free HMO coverage for self and dependent from Day 1; Also contribute to society through ourWNS Cares Foundation, where you have the opportunity to support meaningful initiatives and make an impact in the community.

Job Description

Data Engineering Lead
We are looking for a Data Engineering Lead with 8 to 12 years of experience to lead the build of data pipelines for an enterprise finance data platform on Azure, Databricks and Snowflake. You will run the data engineering team, own delivery from source systems through to certified Gold data products, and set the engineering standards the team works to.
KEY RESPONSIBILITIES
Lead a team of data engineers building ingestion and transformation pipelines
Deliver ingestion from finance source systems using change data capture, Azure Data Factory batch loads, API and event-driven feeds, and governed manual uploads
Build the Bronze, Silver and Gold layers in Databricks, including conformed dimensions and Gold data domains
Build Gold data domains for financial control, FP&A, tax, recharges and project accounting with the Data Architect
Publish certified data products from Databricks to Snowflake for reporting and analysis
Build data quality, reconciliation and matching checks into pipelines with the data quality team
Move recurring Dataiku analyst workflows into engineered Databricks pipelines
Set coding standards, branching, code review and CI/CD practices in Azure DevOps
Estimate work, plan sprints and report progress to the Engagement Manager
Tune pipeline performance and manage compute usage
Support production issues and handover to the support team
TECHNICAL SKILLS
Must-have
Databricks, including PySpark, Spark SQL, Delta Lake, Workflows and Unity Catalog
Snowflake SQL, data loading and performance tuning
Azure Data Factory
Python and advanced SQL
Dimensional modelling
Git and CI/CD with Azure DevOps
Leading engineering teams in agile delivery
Good-to-have
Informatica CDC and PowerCenter
API Management, Service Bus and Functions
Delta Live Tables
Dataiku
Microsoft Purview
DOMAIN KNOWLEDGE
Banking finance data, including general ledger, sub-ledgers, intra-group and recharges
Finance systems such as SAP ECC, BW and BPC, TM1, Alfa and other lending platforms
Treasury and banking data from systems such as TMS, T24 and bank statement feeds
CERTIFICATIONS (GOOD TO HAVE)
Databricks Certified Data Engineer Professional
SnowPro Advanced: Data Engineer
EXPERIENCE AND QUALIFICATIONS
8 to 12 years in data engineering, with at least 3 years leading teams
Delivered at least one cloud data platform on Databricks or Snowflake into production
Experience on data programmes in banking or financial services
Degree in engineering or computer a

Qualifications

Graduate/Post Graduate

By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply