Lead Principal Data Engineer

Peter Millar; North Carolina; On-site; USD 140,000 - 190,000; Full time

Job summary

Peter Millar is seeking a Lead / Principal Data Engineer to own the modern data platform across Microsoft Fabric and OneLake. You will define architecture, standards, and production operations, guiding in-house data engineering while coordinating with outsourced partners.

This role leads medallion patterns, CI/CD, and AI-ready data foundations for analytics, data science, and GenAI deployments. You will collaborate with the AI Engineering Manager, establish security governance, and optimize cost

Qualifications

• 8+ years in data engineering or data architecture
• 2+ years in a lead or principal capacity
• Expert SQL and Python; strong Spark (PySpark)
• Production experience with Fabric/OneLake platform
• Experience managing outsourced engineering teams
• Exposure to data governance and security/compliance frameworks

Responsibilities

• Own end-to-end Fabric platform architecture and data design
• Govern OneLake strategy and Delta Lake/Parquet standards
• Lead ingestion and transformation at scale with Fabric tools
• Define CI/CD standards and code review practices
• Ensure data quality, lineage, and testing across pipelines
• Lead outsourced engineering partnerships and mentor staff

Skills

SQL

Python

Spark (PySpark)

CI/CD

Git

Data governance

Education

Bachelor’s in Computer Science/Engineering

Master’s or Microsoft certifications

Tools

Microsoft Fabric

OneLake

Azure AI

Microsoft Foundry (Azure AI Foundry)

Azure Synapse

Azure Data Lake Storage

Azure SQL

Service Bus

Job description

It’s fun to work in a company where people truly BELIEVE in what they’re doing!

We're committed to bringing passion and customer focus to the business.

Peter Millar was founded in 2001 with a single cashmere sweater offered in 24 colors. Based in Raleigh and Durham, North Carolina, the American lifestyle brand has grown to include luxury performance sportswear, seasonal resort and country club apparel, sophisticated classics, casually refined tailored clothing and sartorial accessories.

We strive to capture timeless style upgraded with signature innovations, in designs that are in tune with modern life. We embrace working hard, being kind and doing right by our customers,aiming to set a higher standard for the apparel industry.

The Lead / Principal Data Engineer is the technical owner of Peter Millar’s modern data platform, responsible for the architecture, engineering standards, and production operation of our Microsoft Fabric and OneLake environment. This role brings data engineering and architecture in-house owning the medallion (bronze/silver/gold) architecture, CI/CD standards, and the relationship with outsourced engineering partners, while establishing the AI-ready data foundation on which analytics, data science, and generative AI depend.

ESSENTIAL FUNCTIONS:

Platform Architecture & Ownership

• Own the end-to-end architecture of the Microsoft Fabric environment, including Lakehouse and Warehouse design, the medallion (bronze/silver/gold) pattern, and Direct Lake semantic datasets.
• Design and govern OneLake as the single, organization-wide data lake, managing domains, shortcuts, data mirroring, and Delta Lake/Parquet storage standards.
• Own data ingestion and transformation at scale using Fabric Data Factory pipelines, Dataflows Gen2, and Spark notebooks.
• Define and enforce engineering standards: Git-based source control, CI/CD and deployment pipelines, environment promotion, and code review.

Reliability, Performance & Cost

• Establish monitoring, alerting, and observability across pipelines; ensure SLAs for data freshness and availability.
• Optimize Fabric capacity units, and storage layout, for both performance and cost.
• Implement data quality, lineage, and automated testing frameworks across the platform.

AI-Ready Foundation & GenAI Enablement

• Structure governed, well-modeled data in OneLake to serve as grounding for generative and agentic AI use cases.
• Partner with the AI Engineering Manager to integrate Azure AI services and Microsoft Foundry (formerly Azure AI Foundry) into production data workflows, including retrieval (RAG) pipelines over OneLake.
• Implement security and governance controls, row/column-level security and PII handling, required for AI at scale.

Leadership & Vendor Management

• Direct and set the technical agenda for outsourced engineering partners, shifting them from running the platform to extending it on scoped, time-bound projects.
• Serve as technical hiring manager and interviewer for subsequent engineering hires; mentor junior analytics and data engineers.
• Capture and retain institutional knowledge of our architecture and design patterns in-house.

TECHNICAL COMPETENCIES (REQUIRED):

• Microsoft Fabric — deep, hands-on experience with Lakehouse, Warehouse, Data Factory pipelines, Dataflows Gen2, Spark notebooks, and Direct Lake.
• OneLake — demonstrated experience designing and governing OneLake, including domains, shortcuts, mirroring, and Delta Lake/Parquet standards.
• Azure AI — experience integrating Azure AI services / Azure OpenAI into data and retrieval pipelines.
• Microsoft Foundry (Azure AI Foundry) — working knowledge of the model catalog and RAG/agent grounding for GenAI workloads (applicable to this role).
• Azure data platform — Synapse, Azure Data Lake Storage, Azure SQL, Service Bus, and Spark in production.
• Engineering practice — strong CI/CD, Git-based source control, and infrastructure-as-code.

DESIRED EDUCATION AND EXPERIENCE:

• 8+ years in data engineering / data architecture, including 2+ years in a lead or principal capacity.
• Expert SQL and Python; strong Spark (PySpark) experience.
• Proven track record building and operating a Microsoft Fabric / OneLake platform in production (Fabric-specific experience strongly preferred and commands a premium).
• Experience managing or directing outsourced/consulting engineering teams.
• Exposure to Microsoft Purview, data governance, and security/compliance frameworks.
• Bachelor’s in Computer Science, Engineering, or related field; Master’s or relevant Microsoft certifications (e.g., Fabric Analytics Engineer, Azure Data Engineer Associate) a plus.

If you like wild growth and working with happy, enthusiastic over-achievers, you’ll enjoy your career with us!

Peter Millar & G/FORE are equal opportunity employers. In accordance with anti-discrimination law, it is the purpose of this policy to effectuate these principles and mandates. Both Peter Millar & G/FORE prohibit discrimination and harassment of any type and they afford equal employment opportunities to employees and applicants without regard to race, color, religion, gender, age, national origin, genetic information, marital status, disability status, protected veteran status, sexual orientation, or any other characteristic protected by law. Both Peter Millar & G/FORE comply with applicable state, county and local laws governing non-discrimination in employment.