ETL Data Platform Developer

Robotics Prcocess Automation, LLC; Redmond (WA); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading technology company located in Redmond is seeking a skilled data engineer with over 7 years of experience focused on Microsoft Azure technologies. The role includes designing ETL pipelines, building metadata driven architectures, and enabling data consumption through tools like Power BI. The ideal candidate has strong communication skills and a deep understanding of data governance. This is an excellent opportunity for those looking to innovate in a collaborative environment.

Qualifications

• 7+ years of experience in data engineering focused on Microsoft Azure Data stack.
• Strong understanding of data modeling, data governance, and security best practices.
• Ability to build metadata driven architectures and reusable components.

Responsibilities

• Design and implement ETL pipelines using Microsoft Fabric and Azure Data Factory.
• Build and maintain a metadata driven Lakehouse architecture.
• Enable interactive data consumption via Power BI and Azure OpenAI.
• Collaborate with product teams to understand data needs.

Skills

Executive written and oral communication

Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks)

Azure Data Factory

Azure SQL

Azure Data Lake Storage Gen2

Power BI and/or other visualization tools

SQL

Python

PySpark/Scala

Experience with structured and semi-structured data (JSON, XML, CSV, Parquet)

Data modeling

Data governance

Security best practices

Job description

Key Responsibilities

• Design and implement ETL pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse, warehouse, sql) and Azure Data Factory.


• Build and maintain a metadata driven Lakehouse architecture with threaded datasets to support multiple consumption patterns.


• Develop agent specific data lakes and an orchestration layer for an uber agent that can query across agents to answer customer questions.


• Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics and AI tools.


• Ensure data quality, lineage, and governance across all ingestion and transformation processes.


• Collaborate with product teams to understand data needs and deliver scalable solutions.


• Optimize performance and cost across storage and compute layers.

Required Qualifications

7+ years of experience in data engineering with a focus on Microsoft Azure Data stack and Fabric technologies.

Strong expertise in:

• Executive written and oral communication


• Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks)


• Azure Data Factory, Azure SQL, Azure Data Lake Storage Gen2


• Power BI and/or other visualization tools


• SQL, Python and PySpark/ Scala


• Experience working with structured and semi structured data (JSON, XML, CSV, Parquet).


• Proven ability to build metadata driven architectures and reusable components.


• Familiarity with agent based architectures and conversational AI integration is a plus.


• Strong understanding of data modeling, data governance, and security best practices.

ROBOTIC PROCESS AUTOMATION LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ROBOTIC PROCESS AUTOMATION LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ROBOTIC PROCESS AUTOMATION LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract.