Data Operations Engineer: Pipelines, Automation & Observability

Acora - IT, Cyber & AI; Sydney; On-site; AUD 120,000 - 170,000; Full time

Job summary

Acora in Australia is looking for a Data Operations Engineer to build, operate and optimise data pipelines on Microsoft Fabric and Purview, ensuring governed and scalable data operations to support analytics and AI use cases. The role emphasizes automation, observability and operational excellence.

You will develop and maintain pipelines, optimise performance and costs, implement data quality checks, and act as a second-line responder for incidents.

Qualifications

• Strong SQL with complex queries and performance optimisation.
• Proficient in Python for automation and data processing.
• Hands-on experience with ETL/ELT tools and patterns.
• Experience with cloud platforms (Azure, AWS or GCP).
• Understanding of warehousing concepts (Snowflake, BigQuery, Redshift).
• Familiarity with version control and CI/CD practices.

Responsibilities

• Develop and maintain pipelines using Fabric components (Data Factory, Lakehouse, Warehouse).
• Manage ingestion, transformation and orchestration within Fabric environments.
• Optimise performance and cost of workloads, including capacity-aware optimisation.
• Automate monitoring, alerting, recovery and validation to reduce manual interventions.
• Implement and enhance data quality checks and validation frameworks.
• Act as second-line responder for data incidents and lead resolution of moderately complex issues.
• Share knowledge and support junior team members informally on troubleshooting.
• Contribute to process or solution improvements improving reliability, efficiency or service quality.
• Maintain and improve runbooks and post-incident reviews.

Skills

SQL optimisation

Python scripting

ETL/ELT patterns

Cloud platforms

Data warehousing concepts

Version control / CI/CD

Tools

Microsoft Fabric

Data Factory / Lakehouse / Warehouse

Snowflake

BigQuery

Redshift

Job description

Acora in Australia is looking for a Data Operations Engineer to build, operate and optimise data pipelines on Microsoft Fabric and Purview, ensuring governed and scalable data operations to support analytics and AI use cases. The role emphasizes automation, observability and operational excellence.

You will develop and maintain pipelines, optimise performance and costs, implement data quality checks, and act as a second-line responder for incidents.