Lead Data Engineer, Azure Databricks & Data Platforms

MetLife; Cary (NC); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health insurance

401(k) with employer matching

Paid time off

Tuition assistance

Job summary

MetLife’s U.S. Data & Analytics organization supports the entire U.S. business with data, analytics, and AI. The Lead Data Engineer drives data architecture and reusable pipelines for the Eligibility program using Azure Databricks and cloud tech.

You will mentor engineers, oversee ETL and data warehouses, and partner with IT, BI, and business stakeholders to deliver scalable, cost-efficient data solutions across global teams.

Qualifications

• 8+ years of Data Solutions development and delivery experience with 4+ years in Azure/Databricks.
• Proficiency in SQL, Spark and Python/Scala with performance tuning.
• Hands-on Big Data technologies and data warehousing for analytics.
• Experience designing and governing data pipelines and ETL processes.

Responsibilities

• Design end-to-end data architecture for data hubs and products.
• Own reusable data pipelines using Big Data and Azure Databricks.
• Lead and mentor a team of data engineers across projects.
• Develop scalable ETL processes and data quality controls.
• Collaborate with IT, BI, and business stakeholders on requirements.

Skills

Azure Databricks

SQL

Spark

Python

Data Warehouses

ETL

CI/CD

Big Data

Tools

Azure Data Factory

Delta Lake

PowerShell

Job description

MetLife’s U.S. Data & Analytics organization supports the entire U.S. business with data, analytics, and AI. The Lead Data Engineer drives data architecture and reusable pipelines for the Eligibility program using Azure Databricks and cloud tech.

You will mentor engineers, oversee ETL and data warehouses, and partner with IT, BI, and business stakeholders to deliver scalable, cost-efficient data solutions across global teams.