Senior Azure Data Engineer

Recruitment Hive; Canberra; Hybrid; AUD 115,000 - 155,000; Full time

Job summary

The Recruitment Hive Pty Ltd is seeking a Senior Azure Data Engineer to design and operate scalable ETL/ELT pipelines in Azure for a federal agency. You will optimize T-SQL, integrate REST APIs, and manage CI/CD in Azure DevOps across ADLS Gen2, Synapse, and Azure SQL.

Some work-from-home options are available in Canberra. Applicants should have a relevant degree and extensive Azure experience, with on-call rotations and incident response involvement.

Qualifications

• Experience designing, developing, and orchestrating scalable ETL/ELT pipelines using Azure Data Factory.
• Advanced ability to write, optimize, and troubleshoot complex T-SQL (stored procedures, functions, views).
• Experience ingesting and exchanging data via REST/SOAP APIs and handling authentication (OAuth2, tokens, managed identities).
• Strong understanding of the wider Azure ecosystem (ADLS Gen2, Azure SQL, Key Vault, Azure Functions, Synapse).
• Background in building and managing CI/CD pipelines using Azure DevOps for deployment and ops.

Responsibilities

• Design and build ETL/ELT pipelines in Azure Data Factory.
• Write and optimize complex T-SQL.
• Manage source control with Git and maintain Azure DevOps pipelines.
• Work across Azure services: ADLS Gen2, Blob Storage, Azure SQL, Synapse, Key Vault, Functions, Logic Apps.
• Monitor pipeline runs, set up alerts, troubleshoot failures, and analyse logs and dashboards.

Skills

ETL/ELT design

T-SQL

REST APIs

OAuth2

CI/CD pipelines

Azure monitoring

Education

Bachelor's or Master's degree in CS/Engineering

Tools

Azure Data Factory

Azure DevOps

Azure Synapse

ADLS Gen2

Azure SQL

Key Vault

Azure Functions

Logic Apps

Job description

• NV1 Security Clearance required - APS6 equivalent
• Canberra, ACT - Some Work from Home considered

Our client, an independent Federal agency in charge of organising, conducting and supervising Australian elections, are seeking the experience of a Senior Azure Data Engineer.

Duties of the Senior Azure Data Engineer

• Design and build ETL/ELT pipelines in Azure Data Factory;
• Write and optimize complex T-SQL (stored procedures, functions, views);
• Manage source control with Git (branching strategy, pull requests) and maintain Azure DevOps pipelines;
• Work across Azure services: Data Lake Storage (ADLS Gen2), Blob Storage, Azure SQL, Synapse, Key Vault, Azure Functions, and Logic Apps;
• Monitor pipeline runs, set up alerts (Azure Monitor, Log Analytics), troubleshoot failures, and analyse logs, metrics, and monitoring dashboards to detect anomalies and failures early;
• Participate in on-call support rotations and respond to high-priority incidents as needed.

Skills and Experience Required

• Demonstrated experience designing, developing, and orchestrating scalable ETL/ELT pipelines using Azure Data Factory;
• Advanced ability to write, optimize, and troubleshoot complex T-SQL (stored procedures, functions, views);
• Practical experience ingesting and exchanging data via REST/SOAP APIs, handling authentication (OAuth2, tokens, managed identities);
• Solid understanding of the wider Azure ecosystem (ADLS Gen2, Azure SQL, Key Vault, Azure Functions, Synapse).
• Background in building and managing CI/CD pipelines using Azure DevOps, enabling streamlined deployment and operational efficiency;
• Prior experience in federal government data domains;
• Bachelor's or Master's degree in a relevant field (e.g. Computer Science, Data Science, Statistics, Engineering).

Please note, applications close on Tuesday, 03 November 2026 - 11:00am, Canberra time

We Value Diversity

The Recruitment Hive is a proud Equal Opportunity Employer. We recognise the value of diverse perspectives and experience and are committed to an inclusive workplace where everyone feels valued and respected for who they are. We encourage people with disability, indigenous, veterans and people of all backgrounds and abilities to express their interest in this role.