Lead Data Engineer - Remote (Microsoft Fabric)

United States Digital Space LLC; United States; Remote; USD 120,000 - 150,000; Full time

Job summary

United States Digital Space LLC is seeking a Lead Data Engineer to design and implement scalable data engineering solutions using Microsoft Fabric. You will lead ETL/ELT pipelines, metadata-driven ingestion, and robust data warehousing.

You will provide technical leadership, govern data assets with Purview, and collaborate with stakeholders to deliver optimized data models for Power BI, while aligning CI/CD practices with DevOps.

Qualifications

• Bachelor's degree in CS/IT/engineering or related field.
• 8+ years in data engineering with 3–4+ years on Fabric or similar cloud platforms.
• Proven enterprise ETL/ELT design experience.
• Strong cloud analytics and data governance understanding.

Responsibilities

• Lead design and implementation of enterprise data eng solutions using Microsoft Fabric.
• Develop and optimize ETL/ELT pipelines for processing.
• Architect metadata-driven ingestion and transformation frameworks.
• Maintain PySpark notebooks for data processing.
• Design robust data warehousing with Microsoft Fabric.
• Provision and govern Fabric workspaces with security controls.
• Implement data governance, cataloging, metadata, and lineage with Purview.
• Ensure data quality, security, and regulatory compliance including PII.
• Collaborate with stakeholders to translate requirements into technical solutions.
• Optimize pipelines for performance, scalability, reliability, and maintainability.
• Support Power BI by developing optimized data models and curated datasets.
• Work with DevOps to establish CI/CD pipelines and release management.

Skills

Microsoft Fabric

Microsoft Purview

PySpark

Data Modeling

SQL

Python

Power BI

DevOps / CI-CD

OneLake

Data Warehousing

Education

Bachelor's degree

Tools

Microsoft Fabric

Microsoft Purview

Fabric Workspace Provisioning

Fabric Data Pipelines

PySpark Notebooks

SQL

Python

Power BI

Azure DevOps

Git

CI/CD Pipeline

Data Modeling

Job description

United States Digital Space LLC is seeking a Lead Data Engineer to design and implement scalable data engineering solutions using Microsoft Fabric. You will lead ETL/ELT pipelines, metadata-driven ingestion, and robust data warehousing.

You will provide technical leadership, govern data assets with Purview, and collaborate with stakeholders to deliver optimized data models for Power BI, while aligning CI/CD practices with DevOps.