Data Engineering Platforms On Microsoft Azure

Tech Aalto; Melbourne; On-site; AUD 150,000 - 210,000; Full time

Job summary

Tech Aalto in Melbourne is seeking a senior Data Engineer to design and implement scalable data engineering platforms on Microsoft Azure. You will lead the setup and management of Azure-based data environments and drive end-to-end data warehousing using Azure Data Factory and Synapse Analytics.

Collaborate with cross-functional teams to gather requirements, design efficient data processing pipelines, and ensure high availability, reliability and performance of cloud-native systems.

Qualifications

• Minimum of 10 years of experience in managing and maintaining large-scale databases.
• Bachelor's degree in Engineering or related field (B.Tech/B.E.).
• Strong expertise in SQL Server database administration, including database design, maintenance, performance tuning, and troubleshooting.
• Hands-on experience with DevOps tools and CI/CD pipeline management.

Responsibilities

• Design and implement scalable data engineering platforms on Microsoft Azure.
• Lead the setup and management of Azure-based data engineering environments.
• Develop and maintain large-scale data warehousing solutions using Azure Data Factory (ADF) and Synapse Analytics.
• Collaborate with cross-functional teams to gather requirements and design optimized data processing pipelines and scalable architectures.
• Ensure high availability, reliability, and performance of cloud-based systems through effective monitoring and DevOps practices.
• Provide expert guidance on best practices for migrating data workloads to the Azure cloud environment.

Skills

Azure Cloud Platform

Azure Synapse Analytics

Azure Data Factory (ADF)

Data Engineering Platform Design

Gateway Configuration

SSO Implementation

CI/CD & DevOps

Education

Bachelor's degree in Engineering

Tools

Azure Cloud

Azure Synapse Analytics

Azure Data Factory

CI/CD Tools

DevOps

Job description

Job Description: Data engineering platforms on Microsoft Azure

Roles and Responsibilities

• Design and implement scalable data engineering platforms on Microsoft Azure.
• Lead the setup and management of Azure-based data engineering environments.
• Develop and maintain large-scale data warehousing solutions using Azure Data Factory (ADF) and Synapse Analytics.
• Collaborate with cross-functional teams to gather requirements and design optimized data processing pipelines and scalable architectures.
• Ensure high availability, reliability, and performance of cloud-based systems through effective monitoring and DevOps practices.
• Provide expert guidance on best practices for migrating data workloads to the Azure cloud environment.

Desired Candidate Profile

• Minimum of 10 years of experience in managing and maintaining large-scale databases.
• Bachelor's degree in Engineering or a related field (B.Tech/B.E.).
• Strong expertise in SQL Server database administration, including database design, maintenance, performance tuning, and troubleshooting.
• Hands-on experience with DevOps tools and CI/CD pipeline management.

Key Skills

• Azure Cloud Platform
• Azure Synapse Analytics
• Azure Data Factory (ADF)
• Data Engineering Platform Design
• Gateway Configuration
• Single Sign-On (SSO) Implementation
• CI/CD and DevOps Integration