Data Engineer – Azure Data Factory and SQL Database Expertise

Tech Aalto Pte ltd; Sydney; On-site; AUD 120,000 - 170,000; Full time

Job summary

Tech Aalto Pte ltd in Sydney is seeking a Data Engineer with Azure Data Factory and SQL Database expertise to design and implement data pipelines, focusing on Azure cloud platforms and data warehousing.

You will build scalable ETL/ELT processes, optimize T-SQL queries, and ensure data quality and security while collaborating with stakeholders and supporting CI/CD and Git workflows.

Qualifications

• Strong background in Data Warehousing, ETL/ELT, and robust data pipelines on Azure.
• Experience with Azure Data Factory, Azure SQL Database, and Azure cloud services.
• Ability to collaborate with stakeholders to gather requirements and provide technical solutions.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT processes using Azure Data Factory and other Azure cloud services.
• Write and optimize T-SQL procedures for querying, data transformation, and validation in a Data Warehouse environment.
• Develop and maintain metadata-driven data load frameworks for automated processing.
• Implement dynamic data masking and ensure data security within Azure SQL Databases.
• Perform data modeling to support Data Warehousing and Data Mart architecture.
• Collaborate with stakeholders to gather requirements and provide technical solutions that meet business needs.
• Ensure data quality checks and implement quality management processes.
• Contribute to CI/CD pipeline implementation using Azure DevOps.
• Maintain repository management using Git version control.
• Engage in peer programming and contribute to agile project delivery.
• Work with Azure Functions and Logic Apps to extend data integration capabilities.
• 5+ years of experience as a Microsoft Azure Cloud ADF Data Engineer, including T-SQL in a Data Warehouse environment.
• Solid understanding of Data Warehousing and Data Mart Architectures on Azure Cloud.
• Proficiency in SQL for data querying, transformation, and validation.
• Experience in building metadata-driven automation frameworks on Azure.
• Strong knowledge of data security practices and dynamic data masking in Azure SQL Database.
• Hands-on experience with Azure Data Lake, Azure SQL Database, Azure Functions, and Logic Apps.
• Experience in Agile delivery within a team.
• Familiarity with peer programming practices.
• Knowledge of SPSS programming language.
• Experience in the Transport Safety industry (beneficial).
• CI/CD pipelines in Azure DevOps and Git.
• Agile Scrum Master experience (optional).
• Strong communication with business and technical stakeholders.

Skills

Azure Data Factory (ADF)

SQL

T-SQL

Data Warehousing

ETL/ELT

Azure SQL Database

Metadata-driven data load

Data modeling

Data security

Azure Data Lake

Azure Functions

Logic Apps

CI/CD pipelines

Azure DevOps

Git

Peer programming

Agile/Scrum

SPSS

Transport Safety industry

Agile Scrum Master

Tools

Git

Azure DevOps

Job description

Data Engineer – Azure Data Factory and SQL Database Expertise

Sydney

Job Description: Data Engineer – Azure Data Factory and SQL Database Expertise

We are seeking a skilledData Engineerwith expertise in Microsoft Azure Data Factory (ADF) and SQL Database to join our dynamic team. The ideal candidate will have a strong background in Data Warehousing, ETL/ELT processes, and building robust data pipelines on Azure cloud platforms. This role is critical to ensuring efficient data modeling, integration, and transformation processes to support business operations and decision-making.

Key Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT processes usingAzure Data Factory (ADF)and other Azure cloud services.
• Write and optimizeT-SQL proceduresfor querying, data transformation, and validation in a Data Warehouse environment.
• Develop and maintainmetadata-driven data load frameworksfor automated processing.
• Implement dynamic data masking and ensure data security withinAzure SQL Databases.
• Perform data modeling to support Data Warehousing and Data Mart architecture.
• Collaborate with stakeholders to gather requirements and provide technical solutions that meet business needs.
• Ensuredata quality checksand implement quality management processes.
• Contribute toCI/CD pipeline implementation and managementusing Azure DevOps.
• Maintain repository management usingGit version control.
• Engage inpeer programmingand contribute to agile project delivery.
• Work withAzure FunctionsandLogic Appsto extend data integration capabilities.
• 5+ yearsof experience as a Microsoft Azure Cloud ADF Data Engineer, including T-SQL in a Data Warehouse environment.
• Solid understanding ofData Warehousing and Data Mart Architectureson Azure Cloud.
• Proficiency inSQLfor data querying, transformation, and validation.
• Experience in building metadata-driven frameworks for automation on Azure.
• Strong knowledge ofdata security practicesand dynamic data masking in Azure SQL Database.
• Hands-on experience withAzure Data Lake, Azure SQL Database, Azure Functions, and Logic Apps.
• Minimum3 yearsof experience in design and build using an agile delivery framework.
• Familiarity withpeer programmingpractices.
• Knowledge ofSPSS programming language.
• Experience in theTransport Safety industry(highly beneficial).
• Proficiency withCI/CD pipelinesin Azure DevOps and version control with Git.
• Agile Scrum Masterexperience (optional but advantageous).
• Strong communication skills for engaging business and technical stakeholders.

Qualifications and Skills

• Expertise indata engineering technologiesincluding data extraction, integration, and transformation.
• In-depth knowledge ofdata modelingand working with various file types, databases, and APIs.
• Hands-on experience withdata quality management processes.