Senior Data Engineer - Azure ETL Pipelines & Analytics

Data Knowhow; Canberra; Hybrid; AUD 110,000 - 140,000; Full time

Benefits offered by this job

Mentoring and training

12% superannuation

Job summary

Data Knowhow is seeking a seasoned Data Engineer in Canberra to design, build, and support ETL/ELT pipelines using Azure Data Factory and SQL-based data models. You will collaborate with data architects, modellers, and business stakeholders to deliver analytics-ready datasets for analytics and BI solutions.

The role requires strong communication, a solid grasp of the data modelling lifecycle, and experience with Azure services such as ADLS Gen2, Azure SQL, Key Vault, Functions, and Synapse.

Qualifications

• Experience designing, developing, and orchestrating scalable ETL/ELT pipelines in Azure Data Factory.
• Advanced ability to write and troubleshoot complex T‑SQL (procedures, functions, views) and optimize queries.
• Experience exchanging data via REST/SOAP APIs with authentication and parsing JSON/XML responses.
• Strong communication and documentation skills across technical and business teams.

Responsibilities

• Design and build ETL/ELT pipelines in Azure Data Factory with linked services, datasets, and integration runtimes.
• Write, optimize, and troubleshoot T-SQL with indexing strategy and performance tuning.
• Maintain source control with Git and manage Azure DevOps pipelines for automated deployments.
• Monitor pipelines, set up alerts, troubleshoot failures, and analyze logs and metrics.
• Collaborate with data architects, modellers, analysts, and stakeholders to translate requirements into solutions.
• Contribute to SAFe/agile ceremonies and participate in on-call support as needed.
• Provide production support and incident resolution for data platform operations.

Skills

ETL/ELT pipelines

T-SQL performance tuning

analytical problem solving

stakeholder collaboration

communication skills

Education

Bachelor's degree in Computer Science

Master's degree in a relevant field

Tools

Azure Data Factory

Git

Azure DevOps

ADLS Gen2

Azure SQL

Key Vault

Azure Functions

Azure Synapse

Job description

Data Knowhow is seeking a seasoned Data Engineer in Canberra to design, build, and support ETL/ELT pipelines using Azure Data Factory and SQL-based data models. You will collaborate with data architects, modellers, and business stakeholders to deliver analytics-ready datasets for analytics and BI solutions.

The role requires strong communication, a solid grasp of the data modelling lifecycle, and experience with Azure services such as ADLS Gen2, Azure SQL, Key Vault, Functions, and Synapse.