Data Engineer

Rashi Joshi; City of Melbourne; On-site; AUD 120,000 - 150,000; Full time

Job summary

A prominent Victorian State Government Organisation is seeking a data engineering professional to design, build and operate data pipelines and warehousing solutions in Azure. You will collaborate with the Manager Data Strategy, Management and Transformation to uphold high performance and integrity.

Responsibilities include leading delivery, budgeting, planning, and creating technical docs. Experience with ArcGIS GIS data and cloud migration is preferred.

Qualifications

• Have minimum 5 years’ experience in cloud data technologies including Microsoft Azure Data Services, Azure Data Lake, Azure Data Factory, Azure Databricks, SQL and Power BI.
• Hands-on experience in Python and Rest APIs.
• Experience delivering data engineering solutions and implementations.
• Familiarity with deployment and data lifecycle management practices.
• Experience designing and optimising workloads within capacity constraints to ensure reliable, performant pipelines
• Knowledge of spatial data management (GIS) and ETL platforms preferably ArcGIS is preferrable
• Experience migrating and modernising data solutions from on-premises or legacy systems into Microsoft Cloud.

Responsibilities

• Lead and role model high standards of performance, accountability, collaboration, ethics, and integrity;
• manage the allocated resources, budgets, contribute to business and project planning and reporting;
• Support team to identify enterprise needs;
• design and build solutions for spatial and non-spatial data acquisition and ingestion, warehousing, architecture, and engineering based on requirements.
• Support team to plan and execute testing in accordance with corporate practices and standards.
• Create and maintain technical documentation, including but not limited to define and design, service level agreements, interface agreements, quick reference guides, data registries.

Skills

Azure Data Services

Azure Data Lake

Azure Data Factory

Azure Databricks

SQL

Power BI

Python

REST APIs

Data engineering

ArcGIS

Tools

ArcGIS

Job description

Your new company A prominent Victorian State Government Organisation

Your new role

You will be working closely with the Manager Data Strategy, Management and Transformation, you will actively contribute to a positive organisational culture and achieve the highest standards of performance and integrity.

Responsibilities

• Lead and role model high standards of performance, accountability, collaboration, ethics, and integrity;
• manage the allocated resources, budgets, contribute to business and project planning and reporting;
• Support team to identify enterprise needs;
• design and build solutions for spatial and non-spatial data acquisition and ingestion, warehousing, architecture, and engineering based on requirements.
• Support team to plan and execute testing in accordance with corporate practices and standards.
• Create and maintain technical documentation, including but not limited to define and design, service level agreements, interface agreements, quick reference guides, data registries.

Requirements

• Have minimum 5 years’ experience in cloud data technologies including Microsoft Azure Data Services, Azure Data Lake, Azure Data Factory, Azure Databricks, SQL and Power BI.
• Hands‑on experience in Python and Rest APIs.
• Experience delivering data engineering solutions and implementations.
• Familiarity with deployment and data lifecycle management practices.
• Experience designing and optimising workloads within capacity constraints to ensure reliable, performant pipelines
• Knowledge of spatial data management (GIS) and ETL platforms preferably ArcGIS is preferrable
• Experience migrating and modernising data solutions from on‑premises or legacy systems into Microsoft Cloud.

What you'll get in return

• Working in an organisation where they develop and grow careers.
• A contractual opportunity offering excellent daily rate
• Flexible working arrangements, including 3 day per week in the office.