Senior Data Engineer - MS Fabric Data Platform Lead

TechWize; New York, Northern (NY, KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

TechWize seeks a Senior Data Engineer to build scalable data platforms on Microsoft Fabric in New York. You will ingest data from AWS, Azure, and direct pipelines, partnering with Solutions and technology teams in an agile setting.

Lead metadata-driven ingestion, enable AI analytics for student data, and ensure governance with Purview, while promoting DevOps practices for rapid, cost-efficient deployment.

Qualifications

• Experience building Microsoft Fabric-based data platforms.
• Ingest data from AWS, Azure, and direct pipelines.
• Knowledge of Bronze/Silver/Gold data layers and scalable modeling.
• Experience with CI/CD and version control practices.
• Experience deploying and managing Microsoft Purview for data governance.
• Familiarity with AI-driven analytics for student data.
• Collaborative work in Agile teams aligning business and DevOps.

Responsibilities

• Implement Metadata Driven Pipeline & DevOps Accelerator to streamline data platform development.
• Create data models for advanced analytics and AI use cases for student data.
• Ingest data from AWS, Azure, or direct pipelines into Microsoft Fabric.
• Set up layered data architecture (Bronze/Silver/Gold) aligned to data domains.
• Apply DevOps practices for scalable, repeatable data solutions.
• Deploy and manage Microsoft Purview for data lineage, cataloging, and governance.

Skills

Microsoft Fabric

Data ingestion

Data modeling

DevOps CI/CD

Purview

AI analytics

Agile collaboration

Data governance

Tools

CI/CD pipelines

Version control

Microsoft Purview

Job description

TechWize seeks a Senior Data Engineer to build scalable data platforms on Microsoft Fabric in New York. You will ingest data from AWS, Azure, and direct pipelines, partnering with Solutions and technology teams in an agile setting.

Lead metadata-driven ingestion, enable AI analytics for student data, and ensure governance with Purview, while promoting DevOps practices for rapid, cost-efficient deployment.