Azure Data Factory Developer (Au Citizen With Security Clearance)

Accenture Australia; Sydney; Hybrid; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Flexible, hybrid working

Work From Anywhere days

Wellbeing & lifestyle allowance

Parental leave and loyalty leave

Job summary

Accenture Australia is seeking a Lead Data Engineer to design, build and operate robust data platforms on Azure, including ADF, SQL Database and data pipelines. You will collaborate with clients and analysts to translate requirements into scalable data solutions and maintain data integrity across warehousing environments.

The role emphasizes strong Python/SQL skills, experience with Databricks or Snowflake, and hands-on DevOps practices.

Qualifications

• 5+ years of experience as a Microsoft Azure Cloud ADF Data Engineer, with T-SQL in a Data Warehouse environment.
• Solid understanding of Data Warehousing and Data Mart Architectures on Azure Cloud.
• Proficiency in SQL for data querying, transformation, and validation.
• Experience in building metadata-driven automation on Azure.
• Strong knowledge of data security and dynamic data masking in Azure SQL Database.
• Hands-on experience with Azure Data Lake, Azure Functions and Logic Apps.
• Minimum 3 years of agile delivery experience.

Responsibilities

• Design, build and maintain scalable data pipelines using Azure Data Factory and Azure cloud services.
• Write and optimize T-SQL in a Data Warehouse environment.
• Develop and maintain metadata-driven data load frameworks for automated processing.
• Implement data masking and data security within Azure SQL Databases.
• Model data for Data Warehousing and Data Mart architectures.
• Collaborate with stakeholders to gather requirements and provide technical solutions.
• Ensure data quality checks and implement quality management processes.
• Contribute to CI/CD pipelines using Azure DevOps and Git version control.
• Engage in peer programming and agile project delivery.
• Work with Azure Functions and Logic Apps to extend data integration capabilities.

Skills

Azure Data Factory

SQL Databases

Data Warehousing

ETL/ELT

Python

Azure DevOps

Git

CI/CD

Data Security

Tools

Databricks

Snowflake

Microsoft Fabric

Azure Functions

Logic Apps

Azure Data Lake

Job description

• What Azure Data Factory Developer Au Citizen W...

Showing 2026 Azure Data Factory Developer Au Citizen With Security Clearance jobs in Sydney

Data Engineer – Azure Data Factory and SQL Database Expertise

Job Description: Data Engineer - Azure Data Factory and SQL Database Expertise

We are seeking a skilled Data Engineer with expertise in Microsoft Azure Data Factory (ADF) and SQL Database to join our dynamic team. The ideal candidate will have a strong background in Data Warehousing, ETL/ELT processes, and building robust data pipelines on Azure cloud platforms. This role is critical to ensuring efficient data modeling, integration, and transformation processes to support business operations and decision‑making.

Key Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT processes using Azure Data Factory (ADF) and other Azure cloud services.
• Write and optimize T‑SQL procedures for querying, data transformation, and validation in a Data Warehouse environment.
• Develop and maintain metadata‑driven data load frameworks for automated processing.
• Implement dynamic data masking and ensure data security within Azure SQL Databases.
• Perform data modeling to support Data Warehousing and Data Mart architecture.
• Collaborate with stakeholders to gather requirements and provide technical solutions that meet business needs.
• Ensure data quality checks and implement quality management processes.
• Contribute to CI/CD pipeline implementation and management using Azure DevOps.
• Maintain repository management using Git version control.
• Engage in peer programming and contribute to agile project delivery.
• Work with Azure Functions and Logic Apps to extend data integration capabilities.

Essential Criteria

• 5+ years of experience as a Microsoft Azure Cloud ADF Data Engineer, including T‑SQL in a Data Warehouse environment.
• Solid understanding of Data Warehousing and Data Mart Architectures on Azure Cloud.
• Proficiency in SQL for data querying, transformation, and validation.
• Experience in building metadata‑driven frameworks for automation on Azure.
• Strong knowledge of data security practices and dynamic data masking in Azure SQL Database.
• Hands‑on experience with Azure Data Lake, Azure SQL Database, Azure Functions, and Logic Apps.
• Minimum 3 years of experience in design and build using an agile delivery framework.
• Familiarity with peer programming practices.

Desirable Criteria

• Knowledge of SPSS programming language.
• Experience in the Transport Safety industry (highly beneficial).
• Proficiency with CI/CD pipelines in Azure DevOps and version control with Git.
• Agile Scrum Master experience (optional but advantageous).
• Strong communication skills for engaging business and technical stakeholders.

Qualifications and Skills

• Expertise in data engineering technologies including data extraction, integration, and transformation.
• In‑depth knowledge of data modeling and working with various file types, databases, and APIs.
• Hands‑on experience with data quality management processes.

Technology is our how, and people are our why. For 20‑plus years we have paired world‑class engineering with deep industry insight, helping global brands create intelligent digital experiences that drive meaningful change. Join us as we expand our Australian Data & AI capability and help clients unlock the full value of their data assets.

Job Description

We’re looking for a Lead Data Engineer to help our clients design, build and operate reliable data platforms that turn complex data into useful business insights.

You’ll work across the data lifecycle, from architecture and source integration through to data pipelines, semantic models, visualisation and reporting. You’ll bring strong engineering skills in Python and SQL, alongside hands‑on experience with at least one of Databricks, Snowflake or Microsoft Fabric.

Working closely with clients, analysts, data scientists and fellow engineers, you’ll translate business requirements into secure, maintainable and scalable data solutions. You’ll also provide technical guidance, contribute to design decisions and help the team strengthen its engineering practices.

What you’ll do

• Work directly with clients to translate business requirments into technical solutions; Providing guidance and contributing to design decisions.
• Design, build and maintain data pipelines to ingest, transform and deliver data from a range of sources, including APIs.
• Develop solutions using Databricks, Snowflake or Microsoft Fabric, selecting approaches that suit the client’s requirements and existing environment.
• Contribute to data architecture and solution design, including data storage, integration and modelling.
• Develop data models, ontologies and semantic layers that establish consistent business definitions and support analytics and reporting.
• Implement pipeline orchestration, scheduling, monitoring and operational support to keep data services reliable.
• Troubleshoot data and pipeline issues, improving performance, scalability and cost efficiency.
• Apply data quality controls, automated testing and validation throughout the data lifecycle.
• Implement role‑based access control and follow security best practices for data platforms and integrations.
• Apply DevOps practices to data engineering, including version control, repository management, CI/CD and automated deployment.
• Build data visualisations and reports that make information clear and useful to business users.
• Document solutions, review code and share knowledge to support maintainable delivery and continuous improvement.

Qualifications

What you’ll bring

• Hands‑on experience delivering production data solutions using one or more of Databricks, Snowflake or Microsoft Fabric.
• Strong programming skills in Python and SQL.
• Experience designing, developing and operating data pipelines, including ETL/ELT processes, orchestration and monitoring.
• A sound understanding of data architecture and modelling techniques, including analytical and dimensional modelling.
• An understanding of ontologies and semantic modelling, and how they connect data structures to business concepts.
• Practical experience optimising data processing and troubleshooting pipeline, query and platform performance.
• Experience integrating data through APIs, including authentication, error handling and reliable data exchange.
• Experience applying role‑based access control (RBAC) and data security best practices.
• Experience using Git, maintaining repositories, writing automated tests and building CI/CD workflows for data solutions.
• Experience developing data visualisations and reports.
• The ability to explain technical choices clearly, work collaboratively with business and technical stakeholders, and guide other engineers.

Useful additional experience

• PostgreSQL, SQL Server, Google BigQuery or Amazon Redshift.
• R or other programming languages.
• Relevant cloud services across Microsoft Azure, AWS or Google Cloud.
• Relevant certifications in Databricks, Snowflake or Microsoft Fabric.

Additional Information

• Flexible, hybrid working – 20 “work from anywhere” days per year on top of our hybrid policy.
• Global career pathways and non‑linear progression; move between domains, disciplines or geographies.
• Continuous learning via certifications, internal academies, tech communities and funded conferences.
• Well‑being & lifestyle allowance , loyalty leave, inclusive parental leave and employee assistance programmes.
• A vibrant, inclusive culture where diverse perspectives power innovation.

Ready to drive AI‑powered transformation?

We look forward to exploring how your expertise can help our clients turn bold ideas into real‑world impact.

Endava is an equal‑opportunity employer. We value the differences that make us stronger and commit to transparent, merit‑based hiring.

Additional Local Benefits

• Monthly Lifestyle Allowance: Contribution towards health and wellbeing activities like gym memberships.
• Novated Leasing: Pre‑tax car leasing benefit for new and used cars.
• Loyalty Leave: Receive an additional day of leave on your 3rd, 4th, and 5th work anniversaries, accumulating up to a maximum of 3 extra days of leave per year.
• Inclusive Parental Leave Policy: 12 weeks of primary carer’s leave and 4 weeks of secondary carer’s leave.
• Work From Anywhere: In addition to our hybrid working policy, we also offer 20 days of working from anywhere per year. Ideal for an extended trip to get away from the city or visiting loved ones.

Work rights and background checks:

To be eligible for a position with us, applicants will need to have valid work rights for Australia and be willing to undergo a comprehensive background checking process, including probity and police checks

We are committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives—because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.

Report Job

Reason for reporting

Report sent. Thank you for your feedback.