Senior Data Engineer-1

PTSI Prudential Technology and Services India Private Limited; India; On-site; INR 1,400,000 - 2,600,000; Full time

Job summary

Prudential plc is seeking a data engineer to design, build, maintain and support data pipelines and core data capabilities on the UDP platform. You will deliver reliable data products supporting operations, analytics, AI, and commissions calculations, working with business, finance, technology and platform teams to transform source data into trusted datasets across the organisation.

The role requires hands-on experience with Python, SQL, Databricks and Spark, plus data modeling, ETL/ELT design

Qualifications

• Hands-on experience with Python, SQL and data pipeline development.
• Experience with ETL/ELT, data models, transformations and orchestration.
• Experience implementing complex calculation logic and financial data processing.
• Knowledge of data quality, observability, lineage, metadata and data contracts.
• Experience with Delta Lake, Unity Catalog, Git, automated testing, CI/CD and cloud data platforms.
• Understanding of APIs, file-based integration, event processing and secure data exchange.
• Agile delivery mindset, software engineering practices and production support.
• Insurance or financial services experience is an advantage.

Responsibilities

• Design, build, test, deploy and maintain data pipelines on UDP platform.
• Develop data ingestion, transformation, enrichment, reconciliation and publishing processes.
• Support commissions calculations with related data processing and calculation outputs.
• Implement reusable data models and curated datasets aligned with standards.
• Ensure data accuracy, lineage, security and auditability across pipelines.
• Implement automated data quality checks, controls, alerts and exceptional handling.
• Monitor production pipelines and provide operational support.
• Collaborate with business, finance, technology, data and platform teams.

Skills

Python

SQL

Databricks

Spark

Data pipelines

ETL/ELT

Data models

Workflow orchestration

Delta Lake

CI/CD

Git

Cloud data platforms

APIs & data exchange

Education

Bachelor in Computer Science

Data Engineering

Tools

Databricks

Unity Catalog

Job description

Prudential’s purpose is to be partners for every life and protectors for every future. Our purpose encourages everything we do by creating a culture in which diversity is celebrated and inclusion assured, for our people, customers, and partners. We provide a platform for our people to do their best work and make an impact to the business, and we support our people’s career ambitions. We pledge to make Prudential a place where you can Connect, Grow, and Succeed.

In this role, you will design, build, maintain, and support data pipelines and core data capabilities on Prudential Singapore’s Unified Data Platform (UDP). You will deliver reliable and auditable data products supporting business operations, analytics, AI, and commissions calculations. As part of this dynamic role, you will work closely with business, finance, technology, data, and platform teams to transform source data into trusted and reusable datasets across the organization.

Job Description

• Design, build, test, deploy, and maintain batch and near-real-time data pipelines on the UDP platform.
• Develop data ingestion, transformation, enrichment, reconciliation and publishing processes.
• Build and maintain data processing for commissions calculations, including rules, rates, adjustments, incentives, deductions, and calculation outputs.
• Implement reusable data models and curated datasets aligned with enterprise and UDP standards.
• Ensure data accuracy, completeness, lineage, traceability, security and auditability across pipelines and calculation processes.
• Implement automated data quality checks, controls, alerts and exception handling.
• Optimize pipeline performance, reliability, scalability, and cost.
• Use source control, automated testing, CI/CD, environment controls, and deployment standards.
• Monitor production pipelines, investigate failures and data discrepancies, and provide operational support.
• Contribute to the enhancement and maintenance of core UDP platform capabilities, engineering standards, and reusable components.

Who we are looking for

• Strong hands‑on experience with Python, SQL, Databricks, Spark, and data pipeline development.
• Experience designing ETL/ELT solutions, data models, transformations, and workflow orchestration.
• Experience implementing complex calculation logic, reconciliation, and financial or commissions-related data processing.
• Good understanding of data quality, observability, lineage, metadata, data contracts and access controls.
• Experience with Delta Lake, Unity Catalog, Git, automated testing, CI/CD, and cloud data platforms.
• Understanding of APIs, file-based integration, event processing, and secure data exchange.
• Good knowledge of Agile delivery, software engineering practices, and production support.
• Strong problem analysis, troubleshooting, communication and collaboration skills.
• Insurance or financial services experience is an advantage.

Working Experience

• At least 5 years of experience in data engineering or software engineering.
• Hands‑on experience delivering and supporting production data pipelines and enterprise data platforms.

Education

Bachelor in Computer Science, Data Engineering, Information Systems, Engineering or equivalent.

Language

Fluent written and spoken English.

We provide equality of opportunity of benefits for all who apply and who perform work for our organisation irrespective of sex, race, age, ethnic origin, educational, social and cultural background, marital status, pregnancy and maternity, religion or belief, disability or part‑time / fixed‑term work, or any other status protected by applicable law.

We encourage the same standards from our recruitment and third‑party suppliers taking into account the context of grade, job and location.

We also allow for reasonable adjustments to support people with individual physical or mental health requirements.

Prudential plc provides life and health insurance and asset management to 17 million customers across 20 markets in Asia and Africa. We are headquartered in Hong Kong and have dual primary listings on the Stock Exchange of Hong Kong and the London Stock Exchange. We are focused on four strategic regions: Greater China, ASEAN, India and Africa. Our customers are served by around 55,000 agents and more than 200 bank partners. Prudential plc is not affiliated in any manner with Prudential Financial, Inc., a company whose principal place of business is in the United States of America or with the Prudential Assurance Company, a subsidiary of M&G plc, a company incorporated in the United Kingdom.

Find out more at www.prudentialplc.com. Follow us on LinkedIn