Senior Data Engineer – Azure & Databricks AI Platforms

Anglicare; New South Wales; On-site; AUD 140,000 - 190,000; Full time

Job summary

Anglicare Sydney is seeking a Senior Data Engineer to design and deliver enterprise data and AI platforms that support decision-making and service delivery across Anglicare. You will lead cloud-native data solutions on Azure and Databricks, building scalable pipelines with Azure Data Factory and Spark, while enabling ML/AI initiatives.

You will drive DevSecOps, CI/CD and infrastructure-as-code practices, ensure governance and security, and mentor teams to deliver high-performing analytics

Qualifications

• Extensive experience designing and delivering cloud-based data platforms.
• Strong expertise across Microsoft Azure, Databricks and Apache Spark.
• Experience building and optimising enterprise-scale ETL/ELT pipelines.
• Strong understanding of DevSecOps, CI/CD and infrastructure automation.

Responsibilities

• Design, build and optimise enterprise data and analytics platforms on Microsoft Azure and Databricks.
• Develop scalable batch and streaming data pipelines using Azure Data Factory, Databricks and Apache Spark.
• Enable machine learning and AI initiatives through robust cloud-based environments.
• Implement DevSecOps, CI/CD and IaC practices across the data platform.
• Establish data governance standards and mentor engineering teams.

Skills

Azure

Databricks

Apache Spark

ETL/ELT pipelines

DevSecOps

CI/CD

Infrastructure as code

Data governance

Data quality

Mentoring

Stakeholder engagement

Tools

Terraform

Bicep

Azure Data Factory

Job description

Anglicare Sydney is seeking a Senior Data Engineer to design and deliver enterprise data and AI platforms that support decision-making and service delivery across Anglicare. You will lead cloud-native data solutions on Azure and Databricks, building scalable pipelines with Azure Data Factory and Spark, while enabling ML/AI initiatives.

You will drive DevSecOps, CI/CD and infrastructure-as-code practices, ensure governance and security, and mentor teams to deliver high-performing analytics