Data Engineer

ACH Group; Adelaide; On-site; AUD 110,000 - 150,000; Full time

Job summary

ACH Group in Adelaide-based head office seeks a Data Engineer to design, build and maintain analytics infrastructure, enabling informed business decisions. You will develop Azure Data Factory pipelines, run Spark workloads in Kubernetes, and design Power BI semantic models while upholding governance and data quality.

Collaboration with analytics teams is essential. This full-time role offers hands-on project work across data integration, ML prep, and scalable database design in a diverse,

Qualifications

• Bachelor's degree in computing or a related technical discipline, or equivalent experience.
• Experience delivering reliable production data pipelines in a large-scale organisation.
• Essential: Azure Data Factory ETL/ELT orchestration, incremental loads, monitoring and troubleshooting.
• Experience with Apache Spark (PySpark or Spark SQL) and Kubernetes deployments.
• Desirable: Microsoft Fabric for lakehouses, warehouses, data pipelines or notebooks.
• Strong coding and data transformation skills; familiarity with BI and data modelling.

Responsibilities

• Develop and maintain data architecture and infrastructure for analytics.
• Build and monitor Azure Data Factory pipelines to integrate data across systems.
• Develop and troubleshoot Spark data processing workloads in Kubernetes environments.
• Design, develop and optimise Power BI semantic models with dimensional modelling, DAX measures, row-level security and performance tuning.
• Develop and support analytics platforms for reproducible ML workflows with analytics teams.
• Design scalable database schemas and optimise queries for dependable data access.
• Apply data governance with metadata, lineage, access controls and quality monitoring.
• Partner with stakeholders to deliver practical data solutions meeting business needs.
• Contribute to other data engineering activities as required.

Skills

Analytical thinking

Stakeholder engagement

Data governance

Problem solving

Education

Degree in computing or related field

Tools

Azure Data Factory

Apache Spark

Kubernetes

Power BI

Microsoft Fabric

Job description

Data Engineer

We are looking for a Data Engineer with hands-on experience in Azure Data Factory to develop, build and maintain data pipelines and analytics infrastructure that support operational efficiencies and informed business decisions. This is a full-time role is based at our Head Office in Mile End.

The role:

• Develop and maintain data architecture and infrastructure that support reliable analytics and reporting
• Build, maintain and monitor Azure Data Factory pipelines to integrate and transform data across systems
• Develop and troubleshoot Apache Spark data processing workloads and support their operation in Kubernetes environments
• Design, develop and optimise Power BI semantic models, including dimensional modelling, data relationships, DAX measures, row-level security and performance tuning
• Develop and support advanced analytics platforms, collaborating with analytics teams to prepare, validate and transform data for reproducible machine learning (ML) workflows
• Design scalable database schemas and administer, maintain and optimise databases and queries to support dependable data access and use
• Apply data governance standards through metadata and lineage management, access controls, and data validation, reconciliation and quality monitoring to safeguard data integrity
• Partner with stakeholders to deliver practical data solutions that meet business needs
• Contribute to other data engineering activities as required

About you:

You translate business needs into reliable, well-governed data solutions and communicate clearly with non-technical stakeholders. The requirements below are essential unless marked desirable:

• A degree or postgraduate qualification in computing or a related technical discipline, or equivalent experience
• Experience delivering and supporting reliable production data pipelines integrating complex sources in a large-scale organisation
• Essential: Azure Data Factory expertise in ETL/ELT orchestration, incremental loads, monitoring, error handling and performance troubleshooting
• Experience with Apache Spark (PySpark or Spark SQL) for distributed data processing, and familiarity with Kubernetes-based deployments, monitoring and troubleshooting
• Desirable: Microsoft Fabric experience with lakehouses, warehouses, data pipelines or notebooks
• Strong coding and technical skills to develop efficient, maintainable solutions for data transformation, automation and analytics
• Hands-on experience with modern data engineering tools for data integration, transformation, orchestration and monitoring
• Power BI semantic model development, including dimensional modelling, relationships, DAX, row-level security and performance tuning
• Understanding of ML concepts and practical data preparation, validation and transformation for reproducible workflows with analytics teams
• Database architecture and data modelling experience, including scalable schemas and database and query optimisation
• Practical data governance experience covering metadata, lineage, access controls and data integrity through validation, reconciliation and quality issue resolution
• Strong analytical and root-cause investigation skills to evaluate solutions and resolve complex data issues using sound architecture and governance principles
• Strong stakeholder engagement to clarify requirements, explain trade-offs and collaborate across business and technical teams
• Ability to prioritise competing demands, meet deadlines and own solutions from development to operational support
• Commitment to clear documentation and continuous improvement in data reliability, performance and maintainability

A satisfactory National Criminal History check less than 12 months old at commencement is required for the successful candidate.

ACH Group celebrates and encourages workforce diversity and does not discriminate on the basis of gender, age, race, sexual orientation, gender identity, religious beliefs, disability or any other basis.

About ACH Group:

At ACH Group we believe that older people should feel valued, respected, connected in their communities and supported to live a good life.

We love what we do, aren't afraid to take action, constantly put our hands up for challenges and celebrate the uniqueness of our community. Most importantly, we bring our best.

If you share our belief, join our team of 1800 employees and hundreds of volunteers and take delight in knowing that you're making a contribution to the lives of older people. You'll do so while enjoying a rewarding career pathway, ongoing training, competitive salary options and a passionate, flexible workplace.