Cloud Data Engineer

Alfred Health

Melbourne

On-site

AUD 120,000 - 160,000

Full time

41 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Salary packaging & novated leasing
Onsite car & bike parking
Fitness Passport membership
Onsite fitness facilities at The Alf​r
KU Children's Services childcare

Job summary

Alfred Health’s Bayside Health division is seeking a Cloud Data Engineer to migrate legacy data integration workloads to Azure Databricks, build ETL/ELT pipelines, and validate data across migrated environments.

You will collaborate with data engineers, analysts, and delivery partners to ensure accurate transformations, data quality, and post-migration verification, while adhering to security and governance standards at The Alfred site in Melbourne.

Qualifications

  • Hands-on data engineering experience with Azure Databricks.
  • Strong SQL skills with Microsoft SQL Server and Databricks SQL.
  • Proficiency in Python and PySpark for production data pipelines.
  • Experience with SSIS migration/refactoring of legacy ETL workloads.

Responsibilities

  • Build, configure, and test Databricks ETL/ELT pipelines for data migration workstreams.
  • Migrate SSIS packages and SQL logic to cloud-native Databricks and Azure services.
  • Translate transformation logic into maintainable Databricks implementations while preserving data outcomes.
  • Perform data validation and reconciliation between legacy and migrated solutions.

Skills

Azure Databricks
SQL
Python
PySpark
SSIS
Git

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks
SSIS

Job description

Bayside Health is a public health service delivering high-quality care across every stage of life for close to 1.2 million people living in metropolitan Melbourne, the Mornington Peninsula, Koo Wee Rup, Bass Coast and Southern Gippsland. We have more than 15 main sites, including hospitals, centres and clinics that provide comprehensive care from welcoming newborns to supporting older people and a full range of services in between. More than 22,000 dedicated staff are focused on providing exceptional, equitable, and locally connected care through shared expertise, compassion, and a commitment to continuous growth. Education and training are central to staff development as we encourage all employees to strive and thrive. Bayside Health was formed following the merger of Alfred Health, Bass Coast Health, Gippsland Southern Health Service, Kooweerup Regional Health Service and Peninsula Health on 1 January 2026.

  • Fixed Term Full Time (80 hrs/fn) position until November 2027
  • Managers and Administrative Workers Grade
  • The Alfred location
The Department

Alfred Health’s Data Analytics Service (DAS) is transforming how data and AI shape patient care, operations, and research. The Cloud Data Engineer supports the delivery of Bayside Health’s modern data platform, with a particular focus on migrating legacy data integration workloads to Azure Databricks, validating migrated data, and transferring technical knowledge to the permanent DAS engineering team.

Position Summary

As the Cloud Data Engineer, you will provide hands-on engineering support for Bayside Health’s migration of legacy data integration workloads to its cloud-native data platform on Azure Databricks. You will design, build, test, and refactor ETL/ELT pipelines; migrate existing SSIS packages to cloud-native equivalents; and support data validation, User Acceptance Testing (UAT), parallel run activities, and migration cutover readiness. Working closely with other data engineers, analysts, subject matter experts, and delivery partners, you will ensure transformation logic is accurately implemented, migration defects are resolved, and technical documentation is complete.

What you'll do
  • Build, configure, and test Databricks ETL/ELT pipelines supporting agreed data migration workstreams.
  • Analyse existing SSIS packages, SQL logic, dependencies, schedules, and data flows, and migrate them to cloud-native equivalents in Azure Databricks and supporting Azure services.
  • Translate existing transformation and business logic into maintainable, reusable, and supportable Databricks implementations while preserving required data outcomes.
  • Perform data validation and reconciliation between legacy and migrated solutions, including record counts, keys, data types, transformation results, duplicates, null handling, and historical data where applicable.
  • Investigate and remediate migration defects, failed pipeline runs, data discrepancies, and performance issues in collaboration with relevant technical and business stakeholders.
  • Participate in User Acceptance Testing (UAT), parallel run testing, regression testing, cutover preparation, and post-migration verification.
  • Apply agreed engineering standards including source control, code review, automated testing, deployment processes, naming conventions, and reusable development patterns.
  • Ensure migrated pipelines comply with Bayside Health requirements for data security, privacy, access control, and governance when handling clinical, corporate, and sensitive information.
  • Document pipeline configurations, source-to-target mappings, data flows, dependencies, transformation logic, operational procedures, and known limitations.
  • Provide hands-on knowledge transfer to other data engineers through pairing, walkthroughs, technical demonstrations, runbooks, and structured handover activities.
  • Work collaboratively with data engineers, analysts, infrastructure teams, vendors, and delivery partners to support migration delivery and transition workloads into ongoing operations.
  • Other duties as required.
What we're looking for
  • Demonstrated hands-on experience in data engineering, with delivery experience using Azure Databricks.
  • Strong SQL skills and practical experience working with relational database technologies, particularly Microsoft SQL Server and Databricks SQL.
  • Strong programming skills in Python and/or PySpark, with the ability to develop maintainable production data pipelines.
  • Practical experience with Microsoft SSIS, including understanding package control flows, data flows, dependencies, scheduling, and migration or refactoring of legacy ETL workloads.
  • Good understanding of ETL/ELT patterns, data warehousing concepts, data modelling, and modern Lakehouse or medallion architecture approaches.
  • Demonstrated experience performing data reconciliation, migration validation, defect investigation, and quality assurance across source and target platforms.
  • Experience with source control and software delivery practices such as Git, code review, automated testing, and CI/CD.
  • Ability to troubleshoot pipeline failures, data quality issues, performance bottlenecks, and integration problems in a structured manner.
  • Strong technical documentation skills, including the ability to document transformation logic, mappings, dependencies, operational procedures, and support requirements.
  • Strong communication and collaboration skills, with the ability to work effectively across data, infrastructure, business, and vendor teams.
  • Demonstrated ability to transfer knowledge through pairing, walkthroughs, mentoring, and practical handover to other engineering teams.
  • Salary packaging & novated leasing through Maxxia
  • Onsite car & bike parking opportunities, deducted pre-tax!! *subject to availability
  • Access for you and your family to an extensive network of health and fitness facilities through Fitness Passport membership
  • Enjoy excellent onsite fitness facilities at The Alfred via ProSport(pre-tax memberships)
  • Childcare services at The Alfred managed by KU Children's Services

Join us in shaping the future of data-driven healthcare.

For enquiries regarding this role, please contact William Librata - Data Platform Lead, on 0430 311 ***.

Applications closes at 11:00pm AEDT Monday, 30 November 2026.

We embrace diversity and strive to have a workforce that reflects the communities we serve. We actively encourage applications from Aboriginal and Torres Strait Islander people, people with disability, and people of all genders, sexualities, and cultural backgrounds.

If you require adjustments to the recruitment and selection process, or require an alternative format to any of the application materials, please don't hesitate to get in touch with the contact person listed on this ad.

In accordance with the Health Services Amendment (Mandatory Vaccination of Healthcare Workers) Act 2020, health care workers in Category A or B roles (as determined by the department's risk ratings) are required to be vaccinated against influenza or hold an acceptable medical exemption.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Analyst
Data Analyst

Alfred Health • Melbourne

On-site
AUD 90,000 - 120,000
Salary packaging & novated leasing
Onsite car & bike parking (pre-tax)
Fitness Passport membership
+2
Data Analyst
Data Analyst

Bayside Health • Melbourne

On-site
AUD 90,000 - 130,000
Salary packaging & novated leasing
Onsite car & bike parking
Fitness Passport membership
+2
Data Scientist
Data Scientist

Bayside Health • Melbourne

On-site
AUD 120,000 - 160,000
Salary packaging
Novated leasing
Onsite parking
+3
Junior Data Engineer
Junior Data Engineer

Alfred Health • Melbourne

On-site
AUD 70,000 - 95,000
5 weeks annual leave
Salary packaging
Onsite car parking
+2
Junior Data Engineer
Junior Data Engineer

Bayside Health • Melbourne

On-site
AUD 90,000 - 130,000
5 weeks annual leave
Salary packaging
Onsite car parking
+4
Improvement Lead
Improvement Lead

Bayside Health • Melbourne

Hybrid
AUD 110,000 - 150,000
Salary Packaging benefits
Novated Car Leasing
Professional learning and development
Improvement Lead
Improvement Lead

Alfred • Melbourne

Hybrid
AUD 120,000 - 180,000
Salary Packaging benefits
Novated Car Leasing
Professional learning and development
+4
Improvement Lead
Improvement Lead

Alfred Health • Melbourne

Hybrid
AUD 140,000 - 170,000
Salary packaging
Novated car Leasing
Professional development
+5
Outpatient Reform Lead
Outpatient Reform Lead

Bayside Health • Melbourne

On-site
AUD 140,000 - 190,000
Salary packaging & novated leasing
Onsite car & bike parking
Fitness Passport membership
+2
Accounts Payable Officer
Accounts Payable Officer

Alfred • Melbourne

On-site
AUD 65,000 - 75,000
Salary packaging & novated leasing
Onsite car & bike parking (pre-tax)
Fitness Passport membership
+2
Top locations