Software Engineer II

MetLif; Hyderabad; On-site; INR 2,400,000 - 4,800,000; Full time

Job summary

MetLife is seeking a Senior Data Engineer to architect and build Azure-based data solutions, lead modernization initiatives, and mentor junior engineers. You'll work with Azure Synapse Analytics, Databricks, ADLS Gen2, and ADF, implementing SCD, CDC, and upsert strategies while optimizing performance and costs.

Responsibilities include designing scalable data pipelines with PySpark, Spark SQL, and ADF, guiding governance and security (RBAC, Key Vault), and driving AI-assisted tooling adoption to

Qualifications

• Proven experience architecting end-to-end Azure data platforms.
• Strong hands-on with Azure Synapse, Databricks, ADF and modern data engineering practices.
• Solid SQL expertise across Oracle, SQL Server and PostgreSQL.
• Experience with data governance, RBAC and Key Vault security.
• Mentor and set coding standards for a data engineering team.

Responsibilities

• Design and implement end-to-end Azure data architectures using Synapse, Databricks and ADLS Gen2.
• Lead data modernization and migration initiatives to Azure.
• Plan migrations, assess solutions and manage complexity.
• Develop scalable data pipelines with PySpark, Spark SQL and ADF.
• Implement data quality, SCD, CDC and upsert/merge processes.

Skills

Azure Synapse Analytics

Azure Databricks

PySpark

Spark SQL

Azure Data Factory

SQL (Oracle/SQL Server/PostgreSQL)

Git/GitHub

CI/CD

Azure DevOps

Data Warehouse Concepts

Medallion Architecture

Data Governance

Data Security (RBAC/Key Vault)

Enterprise-grade Data Platforms

Tools

Git/GitHub

CI/CD

Azure DevOps

Terraform

Job description

We are seeking a Senior Data Engineer to architect and build modern Azure-based data solutions, lead large-scale data platform modernization initiatives, and mentor junior engineers. The ideal candidate should have deep expertise in Azure Synapse Analytics, Databricks, Azure Data Factory (ADF), and modern data engineering practices. Experience with Informatica PowerCenter is a plus but not mandatory.

Key Responsibilities

• Design and implement end-to-end Azure data architectures using Azure Synapse Analytics, Databricks, and ADLS Gen2.
• Lead and support data modernization and migration initiatives to Azure.
• Perform solution assessment, complexity analysis, and migration planning.
• Develop scalable data pipelines using PySpark, Spark SQL, and Azure Data Factory (ADF).
• Implement data engineering best practices including SCD, CDC, UPSERT/MERGE, and data quality frameworks.
• Optimize data processing performance, storage design, and cloud costs.
• Design partitioning, data distribution, and performance tuning strategies.
• Mentor team members and establish coding standards and engineering best practices.
• Drive adoption of AI-assisted development tools such as GitHub Copilot to improve productivity and code quality.

Required Skills

• Strong hands‑on experience with:
  • Azure Synapse Analytics
  • Azure Databricks
  • PySpark
  • Spark SQL
  • Azure Data Factory (ADF)
• Advanced SQL expertise across platforms such as:
  • Oracle
  • SQL Server
  • PostgreSQL
• Experience with Git/GitHub, CI/CD, and Azure DevOps.
• Strong understanding of:
  • Data Warehouse Concepts
  • Medallion Architecture
  • Data Governance
  • Data Security (RBAC, Key Vault)
• Experience designing scalable and enterprise‑grade data platforms.

Good to Have

• Experience with Kafka, Azure Event Hubs, or Streaming Architectures.
• Terraform or Infrastructure as Code (IaC).
• Power BI and Analytics solutions.
• AI/ML integration with data platforms.
• Domain experience in Insurance or Financial Services.

About MetLife

Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World’s 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world’s leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East. As part of our New Frontier strategy, MetLife is building an AI‑enabled, people‑centered future. We’re looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long‑term value. Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we’re inspired to transform the next century in financial services. At MetLife, it’s #AllTogetherPossible .Join us!