Lead Data Engineer (Azure/Microsoft Fabric)

Irvine Technology Corporation; Charlotte (NC); On-site; USD 145,000 - 165,000; Full time

Job summary

Irvine Technology Corporation is seeking a Lead Data Engineer in Charlotte to design, develop and govern data platforms using Azure, SQL Server, Microsoft Fabric, Python and Power BI. This direct-hire role shapes data architecture, governance, and BI capabilities while collaborating with engineering, analytics and business teams.

This leadership position requires 6+ years in data engineering with SQL Server, Python, and Spark or Fabric, plus strong Power BI skills and hands-on Azure experience.

Qualifications

• 6+ years of data engineering experience with SQL Server, Python, and Spark or Microsoft Fabric.
• Strong Power BI data modeling, DAX, security, and deployment experience.
• Hands-on experience with Azure data services (Azure SQL, Data Factory, Synapse).

Responsibilities

• Design and maintain scalable data architectures, models, governance standards, and data quality frameworks.
• Define and implement data governance standards, metadata management, and data retention policies.
• Champion data quality initiatives, profiling, and automated validation across the data pipeline.
• Build and optimize ETL pipelines using Microsoft Fabric or Apache Spark, Python, and SQL server.
• Lead SQL Server migration and modernization efforts while improving performance, reliability, and scalability.
• Architect and govern data models, datasets, security, and performance optimizations.
• Own Azure environment design, cost optimization, security controls (RBAC, encryption, threat detection), and disaster recovery planning.
• Partner with analytics teams to develop Power BI data models, dashboards, security, and self-service reporting.
• Mentor engineers and collaborate with technical and business stakeholders to deliver scalable data solutions.

Skills

SQL Server

Python

Microsoft Fabric

Apache Spark

Power BI

Azure

Data Governance

Mentoring

Tools

Azure Data Factory

Synapse

Data Lake

Job description

Our client is seeking a Lead Data Engineer to design, develop and govern data platforms leveraging Azure, SQL Server, Microsoft Fabric, Python, and Power BI. This newly created Lead role offers the opportunity to shape data architecture, engineering, governance, and BI capabilities while working closely with engineering, analytics, and business teams.

• Job Type: Direct Hire
• Compensation: This job is expected to pay about $145,000-165,000 plus benefits
• This position does not offer sponsorship

What You’ll Do:

• Design and maintain scalable data architectures, models, governance standards, and data quality frameworks.
• Define and implement data governance standards, metadata management, and data retention policies.
• Champion data quality initiatives, profiling, and automated validation across the data pipeline.
• Build and optimize ETL pipelines using Microsoft Fabric or Apache Spark, Python, and SQL server.
• Lead SQL Server migration and modernization efforts while improving performance, reliability, and scalability.
• Architect and govern data models, datasets, security, and performance optimizations.
• Own Azure environment design, cost optimization, security controls (RBAC, encryption, threat detection), and disaster recovery planning.
• Partner with analytics teams to develop Power BI data models, dashboards, security, and self-service reporting.
• Mentor engineers and collaborate with technical and business stakeholders to deliver scalable data solutions.

What Gets You the Job:

• 6+ years of data engineering or closely related experience with deep SQL Server, Python, and Microsoft Fabric or Apache Spark expertise.
• Strong Power BI experience, including data modeling, DAX, performance optimization, security, and deployment.
• Hands‑on experience with Azure data services such as Azure SQL, Data Factory, Synapse, and Data Lake.
• A high level of knowledge regarding data architecture, governance, data quality, security, and compliance.
• Proven ability to lead technical initiatives, mentor engineers, and communicate complex concepts to non-technical stakeholders.

Irvine Technology Corporation provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics.