Data Engineer - Azure / Databricks

Ingrity; Sydney; Hybrid; AUD 120,000 - 150,000; Full time

Job summary

INGRITY in Sydney is seeking a hands-on Data Engineer with strong Azure and Databricks experience to join a growing data team. You will design, build and support scalable data pipelines across modern cloud platforms to deliver reliable, high-quality data solutions.

The role focuses on Azure Databricks, Azure Data Factory and data lakehouse architectures, with Python, PySpark, Spark SQL and SQL driving ETL/ELT workflows. Hybrid work in Sydney is available.

Qualifications

• 3–6 years’ experience in Data Engineering or a similar hands‑on data role.
• Commercial experience with Azure Databricks.
• Strong experience with Azure Data Factory (ADF).
• Hands‑on capability with Python, PySpark, Spark SQL and SQL.
• Experience building and maintaining ETL/ELT data pipelines.
• Understanding of Lakehouse and Medallion Architecture.
• Experience with Azure data services such as ADLS, Azure SQL, Blob Storage and Key Vault.
• Familiarity with Git, Azure DevOps and CI/CD pipelines.
• Understanding of data modelling, data quality and performance optimisation.
• Strong troubleshooting and problem‑solving skills.
• Clear communication skills with technical and business stakeholders.

Responsibilities

• Designing, developing and maintaining scalable data pipelines using Azure Databricks and Azure Data Factory.
• Building and optimising ETL/ELT workflows across cloud-based data platforms.
• Developing solutions using PySpark, Spark SQL, Python and SQL.
• Working with Databricks notebooks, jobs, clusters and workflows.
• Supporting Lakehouse and Medallion Architecture patterns across data platforms.
• Working with Azure services including ADLS/Blob Storage, Azure SQL, Key Vault and Azure DevOps.
• Monitoring data pipelines, troubleshooting issues and performing root‑cause and performance analysis.
• Supporting CI/CD, Git-based development and automated deployments.
• Working closely with Data Engineers, Architects and business stakeholders to deliver reliable data solutions.
• Maintaining strong standards around data quality, security, documentation and engineering best practice.

Skills

Azure Databricks

Azure Data Factory

PySpark

Spark SQL

Python

SQL

ETL/ELT pipelines

Lakehouse Architecture

Medallion Architecture

Azure Data Services

Git

Azure DevOps

CI/CD

Data quality

Data modelling

Tools

dbt

Terraform

Unity Catalog

Azure Log Analytics

Splunk

Job description

We’re looking for aData Engineer with strong Azure and Databricks experience to join a growing data team in Sydney.

This is a hands‑on engineering role where you’ll work across modern cloud data platforms, building and supporting scalable data pipelines and helping deliver reliable, high-quality data solutions.

Data Engineer – Azure / Databricks

Sydney | Hybrid | Mid-Level

In this role, you’ll be

• Designing, developing and maintaining scalabledata pipelines using Azure Databricks and Azure Data Factory.
• Building and optimisingETL/ELT workflows across cloud-based data platforms.
• Developing solutions usingPySpark, Spark SQL, Python and SQL.
• Working withDatabricks notebooks, jobs, clusters and workflows.
• SupportingLakehouse and Medallion Architecture patterns across data platforms.
• Working with Azure services includingADLS/Blob Storage, Azure SQL, Key Vault and Azure DevOps.
• Monitoring data pipelines, troubleshooting issues and performingroot‑cause and performance analysis.
• Supporting CI/CD, Git-based development and automated deployments.
• Working closely with Data Engineers, Architects and business stakeholders to deliver reliable data solutions.
• Maintaining strong standards arounddata quality, security, documentation and engineering best practice.

What we need from you

• Around3–6 years’ experience in Data Engineering or a similar hands‑on data role.
• Commercial experience working withAzure Databricks.
• Strong experience withAzure Data Factory (ADF).
• Good hands‑on capability withPython, PySpark, Spark SQL and SQL.
• Experience building and maintainingETL/ELT data pipelines.
• Understanding ofLakehouse and Medallion Architecture.
• Experience working with Azure data services such asADLS, Azure SQL, Blob Storage and Key Vault.
• Familiarity withGit, Azure DevOps and CI/CD pipelines.
• Understanding of data modelling, data quality and performance optimisation.
• Strong troubleshooting and problem‑solving skills.
• Clear communication skills and the ability to work effectively with both technical and business stakeholders.

Nice to have

• Experience withdbt.
• Exposure toTerraform / Infrastructure as Code.
• Understanding of Databricks Unity Catalog.
• Experience with monitoring tools such as Azure Log Analytics or Splunk.
• Exposure to enterprise-scale data migration or modernisation programs.

Why INGRITY?

AtINGRITY, we’re passionate about helping organisations get more value from their data. You’ll have the opportunity to work alongside experienced data professionals, contribute to interesting client projects and continue developing your skills across modern Azure and Databricks technologies.

If you’re a hands‑on Data Engineer looking for your next opportunity in Sydney, we’d love to hear from you.