Senior Data Engineer – Databricks & Data Modeling/Architecture

MetLife, Inc.; Pune District; On-site; INR 3,500,000 - 7,000,000; Full time

Benefits offered by this job

Health insurance

Performance bonus

Job summary

MetLife, Inc. is seeking a senior data engineer to design and deploy scalable Databricks pipelines for HR data integration.

You will model data across workforce-related domains, migrate legacy Informatica/SQL logic to modern Databricks patterns, and enforce governance with lineage tracking. You will collaborate with a distributed delivery team, mentor junior engineers, and contribute to documentation, runbooks, and data dictionaries while ensuring compliance and data quality across the

Qualifications

• Bachelor's degree in CS/Engineering or related field.
• 7+ years in data engineering, ETL, or data platform roles.
• Hands-on with Azure Databricks, Spark, PySpark, SQL in medallion patterns.
• Experience modernizing legacy ETL and data integration pipelines.
• Proficient with AI-assisted tooling to accelerate development.
• Strong written and verbal communication; aware of US ET/ meetings overlap.

Responsibilities

• Design, build, test, and deploy scalable Databricks pipelines across Bronze/Silver/Gold.
• Model data and maintain source-to-target mappings for HR domains.
• Migrate Informatica/SQL logic to Databricks and re-engineer inbound/outbound feeds.
• Ensure data quality, reconciliation, and automated audit controls.
• Apply governance, security, and privacy for sensitive HR data with lineage.
• Produce technical docs, runbooks, and data dictionaries for operations.
• Collaborate in a distributed team, participate in agile ceremonies, mentor juniors.

Skills

Azure Databricks

Apache Spark

PySpark

SQL

Delta Lake

Data Modeling

AI-assisted engineering

Communication

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Informatica

Oracle HCM

Azure Data Factory

Job description

• Design, develop, test, and deploy scalable pipelines using Databricks, PySpark, Spark SQL, and Delta Lake, spanning Bronze/Silver/Gold (medallion) layers for HR data integration and analytics.
• Build data models – logical, physical, dimensional, and integration – and maintain source-to-target mappings for workforce, organization, employee, position, job, and related HR domains.
• Migrate legacy GDC integrations by re-engineering Informatica, SQL, and stored-procedure logic into modern Databricks patterns, including inbound Oracle HCM feeds and outbound HR data files
• Validate output parity through reconciliation, parallel runs, and source-to-target checks, and build automated data quality, exception handling, and audit controls into pipelines.
• Apply enterprise governance, security, privacy, and role-based access expectations to sensitive HR data, capturing lineage and metadata where applicable.
• Produce production-ready documentation – technical designs, runbooks, data dictionaries, and support handoffs – for maintainable, observable, cost-aware solutions.
• Collaborate within a distributed delivery team, participate in agile ceremonies, mentor junior engineers, and communicate progress, blockers, and risks clearly.

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field, with 7+ years of data engineering, ETL, or data platform experience.
• Azure Databricks & Apache Spark:3+ years hands-on building Delta Lake pipelines with PySpark, Spark SQL, and SQL across a medallion architecture.
• Data modeling & integration:Strong logical/physical/dimensional modeling plus source-to-target mapping, reconciliation, and production cutover support.
• AI-assisted engineering:Proficiency using AI/Copilot tooling to accelerate development, code conversion, and documentation.
• Practical, delivery-focused work style, comfortable turning ambiguous legacy logic into clean target-state designs within a highly governed environment.
• Strong written and verbal communication, with the ability to overlap U.S. Eastern Time for key meetings, design reviews, and issue resolution.

Preferred Qualifications

• Suggested 3+ years modernizing legacy ETL (Informatica-to-Databricks) or building metadata-driven, configuration-driven data frameworks.
• Azure ecosystem:Data Lake Storage, Data Factory, DevOps, Azure SQL/Synapse, Unity Catalog, and Git-based CI/CD.
• HR domain data:Oracle HCM Cloud extracts/PVOs/HDL, workforce analytics, and consumption via Power BI, Crunchr, or similar.
• Experience supporting regulated, sensitive employee data in insurance, financial services, or HR technology.
• Detail-oriented, collaborative, and comfortable working independently against offshore delivery expectations while staying aligned to MetLife leads.

About MetLife

Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World’s 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world’s leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East. As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We’re looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value. Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we’re inspired to transform the next century in financial services. At MetLife, it’s #AllTogetherPossible .Join us!