Azure Databricks Data Engineer – Hybrid Sydney

Ingrity; Sydney; Hybrid; AUD 120,000 - 150,000; Full time

Job summary

INGRITY in Sydney is seeking a hands-on Data Engineer with strong Azure and Databricks experience to join a growing data team. You will design, build and support scalable data pipelines across modern cloud platforms to deliver reliable, high-quality data solutions.

The role focuses on Azure Databricks, Azure Data Factory and data lakehouse architectures, with Python, PySpark, Spark SQL and SQL driving ETL/ELT workflows. Hybrid work in Sydney is available.

Qualifications

• 3–6 years’ experience in Data Engineering or a similar hands‑on data role.
• Commercial experience with Azure Databricks.
• Strong experience with Azure Data Factory (ADF).
• Hands‑on capability with Python, PySpark, Spark SQL and SQL.
• Experience building and maintaining ETL/ELT data pipelines.
• Understanding of Lakehouse and Medallion Architecture.
• Experience with Azure data services such as ADLS, Azure SQL, Blob Storage and Key Vault.
• Familiarity with Git, Azure DevOps and CI/CD pipelines.
• Understanding of data modelling, data quality and performance optimisation.
• Strong troubleshooting and problem‑solving skills.
• Clear communication skills with technical and business stakeholders.

Responsibilities

• Designing, developing and maintaining scalable data pipelines using Azure Databricks and Azure Data Factory.
• Building and optimising ETL/ELT workflows across cloud-based data platforms.
• Developing solutions using PySpark, Spark SQL, Python and SQL.
• Working with Databricks notebooks, jobs, clusters and workflows.
• Supporting Lakehouse and Medallion Architecture patterns across data platforms.
• Working with Azure services including ADLS/Blob Storage, Azure SQL, Key Vault and Azure DevOps.
• Monitoring data pipelines, troubleshooting issues and performing root‑cause and performance analysis.
• Supporting CI/CD, Git-based development and automated deployments.
• Working closely with Data Engineers, Architects and business stakeholders to deliver reliable data solutions.
• Maintaining strong standards around data quality, security, documentation and engineering best practice.

Skills

Azure Databricks

Azure Data Factory

PySpark

Spark SQL

Python

SQL

ETL/ELT pipelines

Lakehouse Architecture

Medallion Architecture

Azure Data Services

Git

Azure DevOps

CI/CD

Data quality

Data modelling

Tools

dbt

Terraform

Unity Catalog

Azure Log Analytics

Splunk

Job description

INGRITY in Sydney is seeking a hands-on Data Engineer with strong Azure and Databricks experience to join a growing data team. You will design, build and support scalable data pipelines across modern cloud platforms to deliver reliable, high-quality data solutions.

The role focuses on Azure Databricks, Azure Data Factory and data lakehouse architectures, with Python, PySpark, Spark SQL and SQL driving ETL/ELT workflows. Hybrid work in Sydney is available.