Junior Data Engineer – Databricks & Data Modeling

MetLife, Inc.; Pune District; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

MetLife, Inc. is seeking a data engineer in Pune to design and maintain data pipelines using Azure Databricks, PySpark, and Delta Lake.

You will transform legacy Informatica mappings and HR integrations into a modern Databricks processing framework, building analytics-ready HR data models under senior guidance. You will perform profiling, testing, and data-quality checks, while documenting mappings, data dictionaries, and runbooks.

Qualifications

• Bachelor’s degree in CS/IT/Data Eng or equivalent, with 2+ years in data engineering.
• Azure Databricks & Spark: 1+ year with PySpark/Databricks, Python and SQL.
• Foundational ETL/ELT, Delta Lake, medallion architecture, data modeling, and source-to-target mappings.
• Willingness to use AI/Copilot tooling to accelerate development, testing, and documentation.
• Curious, detail-oriented, and coachable—able to follow technical direction and produce well-tested work.
• Strong written and verbal communication within a distributed agile delivery team.

Responsibilities

• Develop and maintain data pipelines using Azure Databricks, PySpark, Spark SQL, SQL, and Delta Lake.
• Assist with migrating legacy Informatica mappings and HR integrations to Databricks.
• Build logical/physical, dimensional, analytics-ready models for HR data under senior direction.
• Perform data profiling, unit testing, and defect resolution; implement data-quality checks.
• Produce documentation: mappings, data dictionaries, test cases, runbooks, deployment instructions.
• Follow MetLife governance practices via Unity Catalog and related tools.
• Participate in agile ceremonies and align with U.S. Eastern Time as needed.

Skills

Python

SQL

Azure Databricks

PySpark

Data modeling

ETL/ELT

Delta Lake

Analytical thinking

Communication

Agile / Scrum

Education

Bachelor's degree in Computer Science / IT

Tools

Azure Data Factory

Unity Catalog

Git/CICD

Job description

• Develop and maintain assigned data pipelines using Azure Databricks, PySpark, Spark SQL, SQL, and Delta Lake, building Bronze/Silver/Gold objects to the program’s medallion standards.
• Assist with converting legacy Informatica mappings, SQL, and stored procedures into Databricks processing, and support migration of inbound/outbound HR integrations (including Oracle HCM feeds).
• Implement source-to-target mappings and transformation specs, and help build logical/physical, dimensional, and analytics-ready models for HR data domains under senior direction.
• Perform data profiling, unit testing, and defect resolution; build data-quality and reconciliation checks and compare legacy vs. target-state outputs during parallel runs.
• Produce clear technical documentation – mappings, data dictionaries, test cases, runbooks, and deployment instructions – following established naming, repository, and version-control standards.
• Follow MetLife requirements for handling sensitive HR data, applying approved access-control, classification, and governance practices via Unity Catalog and related tooling.
• Participate in agile ceremonies, incorporate code-review feedback, escape unclear requirements and risks to the Senior Data Engineer, and provide overlap with U.S. Eastern Time.

Required Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or related discipline (or equivalent practical experience), with 2+ years in data engineering, ETL, or data-platform delivery.
• Azure Databricks & Spark:1+ year of practical exposure to Spark, PySpark, Databricks, or a comparable cloud environment, plus working experience with Python and SQL.
• Data fundamentals:Foundational understanding of ETL/ELT, Delta Lake, medallion architecture, data modeling (keys, relationships, normalization, dimensions), and source-to-target mappings.
• AI-assisted engineering:Willingness to use AI/Copilot tooling to accelerate development, testing, and documentation.
• Curious, detail-oriented, and coachable – able to follow technical direction, apply code-review feedback, and produce accurate, well-tested, well-documented work.
• Strong written and verbal communication, comfortable raising questions and blockers clearly within a distributed agile delivery team.

Preferred Qualifications

• Suggested 1–2 years exposure to data migration or ETL modernization (e.g., Informatica-to-Databricks) and building pipelines within a team environment.
• Azure ecosystem:Data Lake Storage, Data Factory, DevOps, Azure SQL/Synapse, Unity Catalog (or Microsoft Purview), and Git-based CI/CD practices.
• HR domain data:Oracle HCM Cloud extracts/PVOs/HDL, or workforce, employee, organization, position, talent, and related HR data.
• Microsoft Azure or Databricks coursework/certification, and experience supporting U.S.-based enterprise clients from an offshore delivery model.
• Experience in insurance, financial services, HR technology, or another regulated, highly governed data environment.

About MetLife

Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World’s 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world’s leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East. As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We’re looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value. Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we’re inspired to transform the next century in financial services. At MetLife, it’s #AllTogetherPossible .Join us!