Data Engineer

ITbility; City of Melbourne; On-site; AUD 130,000 - 170,000; Full time

Job summary

ITbility is seeking a hands-on Data Engineer in Sydney to strengthen our data platform. You will design and implement data pipelines, build APIs and Azure Functions, and work with Azure Data Factory, Synapse, and Databricks in a fast-paced Agile environment.

The role requires 8+ years of data engineering experience, strong SQL and Python skills, and the ability to engage with stakeholders to deliver scalable data solutions.

Qualifications

• 8+ years of experience in data engineering.
• Experience with Azure data services and cloud-based architectures.
• Ability to work independently and in cross-functional teams.

Responsibilities

• Develop and maintain APIs, Azure Functions, and Python-based solutions.
• Process JSON inputs using Python notebooks.
• Design and implement data pipelines using Azure Data Factory and Synapse on Microsoft Azure.
• Build and optimize SQL queries, Synapse packages, and related components.
• Manage and configure Azure cloud environment and its components.
• Apply data warehousing solutions and patterns for scalable architecture.
• Collaborate in Agile DevOps environments and implement CI/CD pipelines using GitHub and Azure DevOps.
• Engage directly with business and technical stakeholders to gather requirements and deliver solutions.

Skills

SQL proficiency

Python programming

Tools

Azure Data Factory (ADF)

Databricks

Azure Synapse

MS Fabric

Job description

We are looking for a hands-on Data Engineer for Sydney to join a team focused on strengthening..

Must-Have Skills

• Strong proficiency in SQL and Python (or any programming language).
• Experience in Azure Data Factory (ADF) pipelines, Databricks, and Azure Synapse.
• Expertise in Data Modeling and Data Warehousing (DWH) concepts.
• Knowledge on MS Fabric

Job Responsibilities

• Develop and maintain APIs, Azure Functions, and Python-based solutions.
• Work with JSON inputs and process them using Python notebooks.
• Design and implement data pipelines using Azure Data Factory and Synapse on Microsoft Azure.
• Build and optimize SQL queries, Synapse packages, and related components.
• Manage and configure Azure cloud environment and its components.
• Apply data warehousing solutions and patterns for scalable architecture.
• Collaborate in Agile DevOps environments and implement CI/CD pipelines using GitHub and Azure DevOps.
• Engage directly with business and technical stakeholders to gather requirements and deliver solutions.

Experience

• 8+ years of experience in data engineering and related technologies.
• Proven ability to work independently and in cross-functional teams.

Preferred Skills

• Development of Azure Function Apps and APIs.
• Familiarity with proc frameworks.

All candidates should have full working rights in Australia. Only shortlisted candidates will be contacted for this role.