Azure Data Engineer: ADF & SQL Pipeline Master

Tech Aalto; Redmond (WA); Vor Ort; AUD 120.000 - 180.000; Vollzeit

Zusammenfassung

Tech Aalto in Australia is seeking a Data Engineer with expertise in Azure Data Factory and SQL Database to design, build, and maintain robust data pipelines in a cloud-based data warehouse environment.

You will implement T-SQL queries, dynamic data masking, and metadata-driven loading frameworks, and collaborate with stakeholders to deliver secure, quality data solutions using Azure services and CI/CD pipelines with Azure DevOps.

Qualifikationen

• 5+ years of experience as Microsoft Azure Cloud ADF Data Engineer in a Data Warehouse environment
• Solid understanding of Data Warehousing and Data Mart Architectures on Azure
• Proficiency in SQL for data querying, transformation, and validation
• Experience building metadata-driven frameworks for automation on Azure
• Strong knowledge of data security practices and dynamic data masking in Azure SQL Database
• Hands-on experience with Azure Data Lake, Azure SQL Database, Azure Functions, and Logic Apps
• Minimum 3 years of experience in design and build using an agile delivery framework
• Familiarity with peer programming practices

Aufgaben

• Design, build, and maintain scalable data pipelines and ETL/ELT processes using Azure Data Factory and other Azure services
• Write and optimize T-SQL procedures for querying, data transformation, and validation in a Data Warehouse environment
• Develop and maintain metadata-driven data load frameworks for automated processing
• Implement dynamic data masking and ensure data security within Azure SQL Databases
• Perform data modeling to support Data Warehousing and Data Mart architecture
• Collaborate with stakeholders to gather requirements and provide technical solutions meeting business needs
• Ensure data quality checks and implement quality management processes
• Contribute to CI/CD pipeline implementation and management using Azure DevOps
• Maintain repository management using Git and engage in peer programming for agile delivery
• Work with Azure Functions and Logic Apps to extend data integration capabilities

Kenntnisse

Azure Data Factory

T-SQL

SQL

Data Warehousing

ETL/ELT

Data Modeling

Data Quality

Data Security

Dynamic Data Masking

Azure Functions

Logic Apps

Azure DevOps

Git

Peer Programming

Agile Delivery

Tools

Azure Data Factory

CI/CD

Git

Jobbeschreibung

Tech Aalto in Australia is seeking a Data Engineer with expertise in Azure Data Factory and SQL Database to design, build, and maintain robust data pipelines in a cloud-based data warehouse environment.

You will implement T-SQL queries, dynamic data masking, and metadata-driven loading frameworks, and collaborate with stakeholders to deliver secure, quality data solutions using Azure services and CI/CD pipelines with Azure DevOps.