Data Platform Lead: Medallion Architecture & Pipelines

AON PLC; Chesterfield (MO); On-site; USD 135,000 - 150,000; Full time

Benefits offered by this job

PTO & paid holidays

401(k) with match

Exclusive discount programs

Health & wellness programs

Job summary

NFP is seeking a Senior Data Platform Engineer to lead the platform architecture and data pipelines for a medallion lakehouse, leveraging Microsoft Fabric, Azure Synapse, and Databricks. The role includes mentoring a small team, establishing CI/CD practices, and ensuring data quality and cost efficiency across ingestion, storage, and serving layers.

You will partner with analytics, clinical, and product teams to translate complex requirements into scalable data solutions in a growing

Qualifications

• 7+ years in data engineering or related field.
• 2+ years leading or mentoring engineers.
• Experience with lakehouse/medallion architectures.
• Strong SQL and Python/PySpark for large-scale transforms.
• Dimensional modeling and star schemas experience.
• BI analytics fluency and serving layer understanding.
• Experience ingesting and conforming heterogeneous data sources.

Responsibilities

• Lead the platform architecture and build.
• Guide a small team of data engineers and perform code reviews.
• Develop and operate ingestion pipelines from multiple sources.
• Ensure data quality, governance, and cost optimization end to end.
• Collaborate with analytics, clinical, and product teams to align roadmaps.

Skills

Data engineering

Platform architecture

Python / PySpark

SQL

Azure Synapse

Databricks

CI/CD for data pipelines

Data governance

Communication

Tools

Microsoft Fabric

Azure Synapse

Databricks

Job description

NFP is seeking a Senior Data Platform Engineer to lead the platform architecture and data pipelines for a medallion lakehouse, leveraging Microsoft Fabric, Azure Synapse, and Databricks. The role includes mentoring a small team, establishing CI/CD practices, and ensuring data quality and cost efficiency across ingestion, storage, and serving layers.

You will partner with analytics, clinical, and product teams to translate complex requirements into scalable data solutions in a growing