Lead Data Engineer — Azure Databricks & Data Architecture

MetLife, Inc.; Cary (NC); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health plan and benefits

401(k) with employer match

Paid time off and holidays

Job summary

MetLife, Inc. is seeking a Lead Data Engineer to architect and build data pipelines and platforms for the U.S. Data & Analytics organization.

You will lead a team of data engineers, partner with IT and business stakeholders, and drive scalable data solutions using Azure Databricks and related cloud technologies. The role requires strong SQL, Spark, Python/Scala, and data governance experience, with a focus on performance, reliability, and cost efficiency in large-scale environments.

Qualifications

• 8+ years of Data Solutions, development, and delivery experience including Azure/Databricks.
• Proficiency with SQL, Spark, Python/Scala, and performance tuning.
• Experience building data warehouses and cloud-based data stores for analytics.

Responsibilities

• Design end-to-end data architecture for data hubs/products.
• Own and build reusable data pipelines using Big Data and Azure Databricks.
• Lead and mentor a team of data engineers and ensure data quality.

Skills

SQL

Spark

Python/Scala

Big Data

Azure Databricks

Data Warehouses

CI/CD

Leadership

Communication

Data Governance

Tools

Azure Databricks

Azure Data Factory

Hive/HBase

Spark

Job description

MetLife, Inc. is seeking a Lead Data Engineer to architect and build data pipelines and platforms for the U.S. Data & Analytics organization.

You will lead a team of data engineers, partner with IT and business stakeholders, and drive scalable data solutions using Azure Databricks and related cloud technologies. The role requires strong SQL, Spark, Python/Scala, and data governance experience, with a focus on performance, reliability, and cost efficiency in large-scale environments.