Azure Data Engineer: Build Scalable Data Pipelines

Soft Labs Pty Ltd; Sydney; On-site; AUD 120,000 - 180,000; Full time

Job summary

Soft Labs Pty Ltd in Sydney seeks an Azure Data Engineer to design, build and maintain scalable data pipelines and architectures in the Microsoft Azure ecosystem. You will collaborate with cross-functional teams to support clients’ data needs and ensure robust data integration, processing, and storage solutions.

The role requires hands-on experience with Azure Data Factory, Databricks and Synapse Analytics, plus Python/SQL/Scala proficiency and a solid grasp of data warehousing, ETL/ELT and

Qualifications

• Experience as a Data Engineer with Microsoft Azure technologies.
• Proficiency in Python, SQL, or Scala.
• Strong understanding of data warehousing, ETL/ELT, and cloud architecture.
• Ability to communicate technical concepts clearly in a team.
• Proactive problem-solving and delivering high-quality enterprise solutions.

Responsibilities

• Designing and implementing data pipelines using Azure data services such as Azure Data Factory, Databricks, and Synapse Analytics.
• Managing and optimizing data storage solutions in Azure, including SQL databases and data lakes.
• Collaborating with software developers, system administrators, and business stakeholders to understand data requirements.
• Ensuring data security, governance, and compliance standards are met across all data workflows.
• Monitoring performance, troubleshooting data integration issues, and implementing necessary optimizations.

Skills

Azure data engineer

Python

SQL

Scala

Data warehousing

ETL/ELT

Communication

Tools

Azure Data Factory

Databricks

Synapse Analytics

SQL databases

Data lakes

Job description

Soft Labs Pty Ltd in Sydney seeks an Azure Data Engineer to design, build and maintain scalable data pipelines and architectures in the Microsoft Azure ecosystem. You will collaborate with cross-functional teams to support clients’ data needs and ensure robust data integration, processing, and storage solutions.

The role requires hands-on experience with Azure Data Factory, Databricks and Synapse Analytics, plus Python/SQL/Scala proficiency and a solid grasp of data warehousing, ETL/ELT and