ETL Data Platform Developer

MACHINE LEARNING TECHNOLOGIES LLC; Redmond (WA); On-site; USD 130,000 - 190,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Redmond, WA seeks an ETL Data Platform Developer to design and implement robust data pipelines using Microsoft Fabric and the Azure data stack. The role focuses on building a metadata-driven Lakehouse and an orchestration layer for cross-agent queries.

You will enable interactive analytics via Power BI and AI tools, ensure data quality, governance, and security, and collaborate with product teams to deliver scalable data solutions while optimizing cost and

Qualifications

• 7+ years of experience in data engineering with a focus on Microsoft Azure Data stack and Fabric technologies.

Responsibilities

• Design and implement ETL pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse ,warehouse, sql)
• Build and maintain a metadata driven Lakehouse architecture with threaded datasets to support multiple consumption patterns.
• Develop agent specific data lakes and an orchestration layer for an uber agent that can query across agents to answer customer questions.
• Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics and AI tools.
• Ensure data quality, lineage, and governance across all ingestion and transformation processes.
• Collaborate with product teams to understand data needs and deliver scalable solutions.
• Optimize performance and cost across storage and compute layers.

Skills

Executive comms

SQL

Python

PySpark/Scala

Data modeling

Data governance

Security best practices

Agent-based architectures

Conversational AI integration

Tools

Microsoft Fabric

Azure Data Factory

Azure SQL

Azure Data Lake Storage Gen2

Power BI

Job description

Job Description

• Job ID: J52988
• Job Title: ETL Data Platform Developer
• Location: Redmond, WA
• Duration: 24 Months + Extension
• Hourly Rate: Depending on Experience (DOE)
• Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, L2-EAD, GC-EAD
• Client: To Be Discussed Later
• Employment Type: W-2, 1099, C2C

Summary

Role : ETL Data Platform Developer

Location : Redmond, WA (Onsite )

Key Responsibilities

• Design and implement ETL pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse ,warehouse, sql)
• Build and maintain a metadata driven Lakehouse architecture with threaded datasets to support multiple consumption patterns.
• Develop agent specific data lakes and an orchestration layer for an uber agent that can query across agents to answer customer questions.
• Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics and AI tools.
• Ensure data quality, lineage, and governance across all ingestion and transformation processes.
• Collaborate with product teams to understand data needs and deliver scalable solutions.
• Optimize performance and cost across storage and compute layers.

Required Qualifications

7+ years of experience in data engineering with a focus on Microsoft Azure Data stack and Fabric technologies.

Strong Expertise In

• Executive written and oral communication
• Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks)
• Azure Data Factory, Azure SQL, Azure Data Lake Storage Gen2
• Power BI and/or other visualization tools
• SQL, Python and PySpark/ Scala
• Experience working with structured and semi structured data (JSON, XML, CSV, Parquet).
• Proven ability to build metadata driven architectures and reusable components.
• Familiarity with agent based architectures and conversational AI integration is a plus.
• Strong understanding of data modeling, data governance, and security best practices.

Equal Opportunity Employer

MACHINE LEARNING TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. MACHINE LEARNING TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will MACHINE LEARNING TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract

Similar Jobs

• Java Developer - 423 W WHEATLAND RD, SUITE 103C, DUNCANVILLE, TX 75116
• Software Developer - 423 W WHEATLAND RD, SUITE 103C, DUNCANVILLE, TX 75116
• Software Developer - DUNCANVILLE, TX
• Software Developer - DUNCANVILLE, TX
• Senior AI Developer - Mettawa, IL

© 2008-2018, Machine Learning Technologies LLC. All Rights Reserved.