Data Engineer - End-to-End Health Data Platform (AWS)

Loop IQ; Melbourne; On-site; AUD 120,000 - 180,000; Full time

Job summary

Loop IQ is seeking a hands-on data engineer to own end-to-end data pipelines in a small, high-trust team. You will build production ETL/ELT processes on AWS using Python and PySpark, ingest data from clinical systems, and model it in a lakehouse with Iceberg or Delta formats.

You'll work closely with software engineers to ensure data quality, implement tests and monitoring, and contribute to shared frameworks. A degree in a technical field and 4+ years of experience are expected.

Qualifications

• 4+ years in data engineering building production pipelines.
• Strong SQL and PySpark for distributed processing.
• Hands-on AWS across compute, storage and orchestration.

Responsibilities

• Build and maintain production ETL/ELT pipelines on AWS using Python and PySpark.
• Own ingestion from third-party clinical systems, healthcare APIs, and enterprise platforms — from the integration itself through to the tables people query
• Model data in our lakehouse — incremental loads, slowly changing dimensions, and schema changes that don’t break downstream
• Handle sensitive data carefully, and help us keep de-identification correct as we add new sources
• Write tests, monitoring, and alerting that catch failures before customers do
• Contribute to our shared in-house frameworks so patterns get reused rather than reinvented
• Work in infrastructure-as-code and CI/CD alongside the rest of the team
• Review other engineers’ work, and help lift how the team builds

Skills

Strong SQL

PySpark

Distributed processing

Education

Degree in Computer Science, Engineering, Data Science, or related field

Tools

AWS

Glue

Databricks

EMR

Spark

Iceberg/Delta lakehouse

Job description

Loop IQ is seeking a hands-on data engineer to own end-to-end data pipelines in a small, high-trust team. You will build production ETL/ELT processes on AWS using Python and PySpark, ingest data from clinical systems, and model it in a lakehouse with Iceberg or Delta formats.

You'll work closely with software engineers to ensure data quality, implement tests and monitoring, and contribute to shared frameworks. A degree in a technical field and 4+ years of experience are expected.