Azure Data Platform Engineer - ETL & Lakehouse Architect

Machine Intelligence Technologies, LLC; Redmond, Northern (WA, KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Machine Intelligence Technologies LLC in Redmond, WA is seeking a senior data engineer to design and implement ETL pipelines using Microsoft Fabric and Azure Data Factory. You will build a metadata-driven Lakehouse architecture and an orchestration layer to support cross-agent queries, enabling interactive data consumption via Power BI and Azure OpenAI.

You will ensure data quality, governance, and security across all ingestion and transformation processes, collaborating with product teams to

Qualifications

• 7+ years of data engineering experience with Azure Data stack and Fabric.
• Strong written and oral communication skills.
• Experience building metadata-driven architectures and reusable components.
• Familiarity with agent-based architectures and conversational AI integration is a plus.
• Strong understanding of data modeling, data governance, and security best practices.

Responsibilities

• Design and implement ETL pipelines using Microsoft Fabric and Azure Data Factory.
• Build and maintain a metadata-driven Lakehouse with threaded datasets.
• Develop agent-specific data lakes and an orchestration layer for cross-agent queries.
• Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics tools.
• Ensure data quality, lineage, and governance across ingestion and transformation processes.
• Collaborate with product teams to understand data needs and deliver scalable solutions.
• Optimize performance and cost across storage and compute layers.

Skills

Executive communication

SQL

Python

PySpark/Scala

Data governance

Data modeling

Tools

Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks)

Azure Data Factory

Azure SQL

Azure Data Lake Storage Gen2

Power BI

Job description

Machine Intelligence Technologies LLC in Redmond, WA is seeking a senior data engineer to design and implement ETL pipelines using Microsoft Fabric and Azure Data Factory. You will build a metadata-driven Lakehouse architecture and an orchestration layer to support cross-agent queries, enabling interactive data consumption via Power BI and Azure OpenAI.

You will ensure data quality, governance, and security across all ingestion and transformation processes, collaborating with product teams to