Data Engineer - AI Pipelines & Analytics

UNSW Employees, Location, Alumni; Sydney; Hybrid; AUD 150,000 - 190,000; Full time

Benefits offered by this job

Monthly Lifestyle Allowance

Novated Leasing

Loyalty Leave

Inclusive Parental Leave Policy

Work From Anywhere

Job summary

Harvey Norman is seeking a Lead Data Engineer to design, build and operate reliable data platforms that turn complex data into actionable business insights. You will work across the data lifecycle, from architecture and source integration through to modelling, visualisation and reporting.

You will bring strong engineering skills in Python and SQL, with hands-on experience in Databricks, Snowflake or Microsoft Fabric, collaborating with clients and teams to deliver secure, scalable data solutions.

Qualifications

• Hands-on experience delivering production data solutions using one or more Databricks, Snowflake or Microsoft Fabric.
• Strong programming skills in Python and SQL.
• Experience designing, developing and operating data pipelines, including ETL/ELT processes, orchestration and monitoring.
• Sound understanding of data architecture and modelling techniques, including analytical and dimensional modelling.
• Experience integrating data through APIs, including authentication, error handling and reliable data exchange.

Responsibilities

• Design, build and maintain data pipelines to ingest, transform and deliver data from a range of sources, including APIs.
• Develop solutions using Databricks, Snowflake or Microsoft Fabric, selecting approaches that suit the client’s requirements and existing environment.
• Contribute to data architecture and solution design, including data storage, integration and modelling.
• Develop data models, ontologies and semantic layers that establish consistent business definitions and support analytics and reporting.
• Implement pipeline orchestration, scheduling, monitoring and operational support to keep data services reliable.
• Troubleshoot data and pipeline issues, improving performance, scalability and cost efficiency.

Skills

Python

SQL

ETL/ELT

Data modelling

Data governance

CI/CD

Git

Problem solving

Documentation

Stakeholder engagement

Tools

Databricks

Snowflake

Microsoft Fabric

Job description

Harvey Norman is seeking a Lead Data Engineer to design, build and operate reliable data platforms that turn complex data into actionable business insights. You will work across the data lifecycle, from architecture and source integration through to modelling, visualisation and reporting.

You will bring strong engineering skills in Python and SQL, with hands-on experience in Databricks, Snowflake or Microsoft Fabric, collaborating with clients and teams to deliver secure, scalable data solutions.