Senior Data Engineer

Babylon Data; Canberra; Hybrid; AUD 140,000 - 190,000; Full time

Job summary

Babylon Data is seeking a Senior Data Engineer to design, develop and support Azure-based data platforms for a government partner. You will build modern ETL/ELT solutions, create analytical datasets and modernise enterprise data capabilities using Microsoft Azure.

You will work in Agile teams to deliver scalable data pipelines, metadata-driven integration and robust data models, with on‑prem and cloud components and a focus on reliability and security.

Qualifications

• Experience designing enterprise ETL/ELT pipelines in Azure Data Factory.
• Proven ability to build metadata-driven data integration solutions.
• Advanced T-SQL development and performance tuning, including stored procedures and functions.
• Dimensional data modelling for analytics warehouses (Star/Snowflake).
• Experience consuming REST and SOAP APIs (JSON/XML transformations).
• Experience with Azure DevOps and Git source control.
• Monitoring, troubleshooting, and supporting enterprise Azure data platforms.

Responsibilities

• Design, develop and optimise ETL/ELT pipelines using Azure Data Factory.
• Build and maintain metadata-driven data pipelines.
• Develop and optimise complex T-SQL including stored procedures, views and functions.
• Design and support dimensional data models and data warehouses.
• Integrate data from REST and SOAP APIs using secure auth.
• Develop and maintain Azure DevOps CI/CD pipelines and Git repos.
• Monitor production data pipelines with Azure Monitor and Log Analytics.
• Collaborate with architects, analysts and stakeholders to deliver scalable solutions.
• Participate in Agile/SAFe ceremonies and maintain coding standards.

Skills

Azure Data Factory

T-SQL

Dimensional modelling

Azure DevOps

Git

REST/SOAP APIs

Metadata-driven data integration

Azure monitoring

Agile/SAFe

Analytical skills

Communication skills

Education

Relevant tertiary qualifications in Computer Science / Data Engineering / Data Science / Statistics / Software Engineering

Tools

Azure Data Factory

Azure DevOps

Git

SQL Server / T-SQL

Job description

Contract Duration: ASAP to 30 June 2027 with 1 x 12-month extension

Start Date: 5 October 2026

Maximum Hours: Up to 40 hours per week

Security Clearance: Must hold an active NV1 Security Clearance

Experience Level: Senior (APS6 Equivalent)

Working Arrangements: Hybrid (Canberra or Sydney office with remote working arrangements available)

About the Opportunity

Our Government partner is seeking an experienced Senior Data Engineer to design, develop and support enterprise-scale Azure data platforms that underpin critical analytics, business intelligence and election systems.

Working within multidisciplinary Agile delivery teams, you will build modern ETL/ELT solutions, develop analytical datasets and contribute to the ongoing modernisation of enterprise data capabilities using Microsoft Azure technologies.

This role offers the opportunity to work across complex cloud-based data environments while collaborating closely with architects, data modellers, analysts and business stakeholders.

Key Responsibilities

• Design, develop and optimise ETL/ELT pipelines using Azure Data Factory.
• Build and maintain metadata-driven and parameterised data pipelines.
• Develop and optimise complex T-SQL including stored procedures, views and functions.
• Design and support dimensional data models (Star and Snowflake schemas).
• Integrate data from REST and SOAP APIs using OAuth2, managed identities and token-based authentication.
• Develop and maintain Azure DevOps CI/CD pipelines and Git repositories.
• Logic Apps
• Monitor and troubleshoot production data pipelines using Azure Monitor and Log Analytics.
• Investigate and resolve production incidents and data integration issues.
• Collaborate with architects, analysts and business stakeholders to deliver scalable technical solutions.
• Participate in Agile and SAFe ceremonies.
• Maintain coding standards, documentation, testing and version control best practices.
• Participate in operational support and on‑call activities when required.

Applicants should demonstrate experience in

• Designing and implementing enterprise ETL/ELT solutions using Azure Data Factory.
• Developing scalable, metadata-driven data integration solutions.
• Advanced T-SQL development, database optimisation and performance tuning.
• Dimensional data modelling and analytical data warehouse design.
• Consuming REST and SOAP APIs including JSON/XML transformation.
• Azure DevOps and Git source control.
• Monitoring, troubleshooting and supporting enterprise Azure data platforms.
• Strong analytical, troubleshooting and problem-solving abilities.
• Excellent written and verbal communication skills.
• Working effectively within Agile or SAFe delivery environments.

Highly regarded experience includes

• Building and maintaining Azure DevOps CI/CD deployment pipelines.
• Relevant tertiary qualifications in Computer Science, Data Engineering, Data Science, Statistics or Software Engineering.