Senior ETL Platform Engineer - Azure Data & Lakehouse

Cloud Analytics Technologies, LLC; Redmond (WA); On-site; USD 150,000 - 190,000; Full time

Job summary

Cloud Analytics Technologies, LLC is seeking a senior data engineer to design and implement ETL pipelines using Microsoft Fabric and Azure Data Factory in Redmond, WA. You will build a metadata-driven Lakehouse architecture and an orchestration layer to enable cross-agent querying, while ensuring data quality, lineage, and governance across all data flows.

The role requires strong expertise in Fabric components, Azure SQL, Data Lake Gen2, Power BI, and Python/Spark/Scala.

Qualifications

• 7+ years of experience in data engineering with a focus on Microsoft Azure Data stack and Fabric technologies.
• Proficient in Microsoft Fabric components (Lakehouse, Dataflows Gen2, Pipelines, Notebooks) and Azure Data Factory.
• Strong SQL, Python and Spark/Scala skills with experience in structured and semi-structured data.
• Experience building metadata-driven architectures with governance and security in mind.
• Familiarity with agent-based architectures and conversational AI integration is a plus.

Responsibilities

• Design and implement ETL pipelines using Microsoft Fabric and Azure Data Factory.
• Build and maintain a metadata-driven Lakehouse architecture to support multiple consumption patterns.
• Develop agent-specific data lakes and an orchestration layer for cross-agent querying.
• Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics tools.
• Ensure data quality, lineage, and governance across all ingestion and transformation processes.
• Collaborate with product teams to understand data needs and deliver scalable solutions.
• Optimize performance and cost across storage and compute layers.

Skills

Microsoft Fabric

Azure Data Factory

Azure SQL

Azure Data Lake Storage Gen2

Power BI

SQL

Python

PySpark

Scala

JSON/XML/CSV/Parquet

Data governance

Data modeling

Security best practices

Agent-based architectures

Job description

Cloud Analytics Technologies, LLC is seeking a senior data engineer to design and implement ETL pipelines using Microsoft Fabric and Azure Data Factory in Redmond, WA. You will build a metadata-driven Lakehouse architecture and an orchestration layer to enable cross-agent querying, while ensuring data quality, lineage, and governance across all data flows.

The role requires strong expertise in Fabric components, Azure SQL, Data Lake Gen2, Power BI, and Python/Spark/Scala.