Lead Data Platform Architect: Microsoft Fabric & OneLake

Peter Millar; North Carolina; On-site; USD 140,000 - 190,000; Full time

Job summary

Peter Millar is seeking a Lead / Principal Data Engineer to own the modern data platform across Microsoft Fabric and OneLake. You will define architecture, standards, and production operations, guiding in-house data engineering while coordinating with outsourced partners.

This role leads medallion patterns, CI/CD, and AI-ready data foundations for analytics, data science, and GenAI deployments. You will collaborate with the AI Engineering Manager, establish security governance, and optimize cost

Qualifications

• 8+ years in data engineering or data architecture
• 2+ years in a lead or principal capacity
• Expert SQL and Python; strong Spark (PySpark)
• Production experience with Fabric/OneLake platform
• Experience managing outsourced engineering teams
• Exposure to data governance and security/compliance frameworks

Responsibilities

• Own end-to-end Fabric platform architecture and data design
• Govern OneLake strategy and Delta Lake/Parquet standards
• Lead ingestion and transformation at scale with Fabric tools
• Define CI/CD standards and code review practices
• Ensure data quality, lineage, and testing across pipelines
• Lead outsourced engineering partnerships and mentor staff

Skills

SQL

Python

Spark (PySpark)

CI/CD

Git

Data governance

Education

Bachelor’s in Computer Science/Engineering

Master’s or Microsoft certifications

Tools

Microsoft Fabric

OneLake

Azure AI

Microsoft Foundry (Azure AI Foundry)

Azure Synapse

Azure Data Lake Storage

Azure SQL

Service Bus

Job description

Peter Millar is seeking a Lead / Principal Data Engineer to own the modern data platform across Microsoft Fabric and OneLake. You will define architecture, standards, and production operations, guiding in-house data engineering while coordinating with outsourced partners.

This role leads medallion patterns, CI/CD, and AI-ready data foundations for analytics, data science, and GenAI deployments. You will collaborate with the AI Engineering Manager, establish security governance, and optimize cost