Lead Data Engineer | Federal Government

Aurec; Canberra; On-site; AUD 140,000 - 200,000; Full time

Benefits offered by this job

Contract: 12 months + extension

Canberra, ACT location only

Job summary

Aurec is seeking a Lead Data Engineer to join a Federal Government environment in Canberra. The role focuses on building modern data platforms, ingestion patterns, and analytics pipelines using Azure and Databricks, with Power BI visuals to support decision-making.

The position emphasizes cloud-based ETL/ELT, data transformation, and collaboration within an Agile team, requiring 5+ years of experience and a valid NV1 clearance. Canberra, ACT only.

Qualifications

• 5+ years of experience as a Data Engineer.
• Proven ability to design and implement ETL/ELT pipelines in cloud environments.
• Strong written and oral communication skills for cross-functional teams.

Responsibilities

• Design, build, and maintain automated ingestion and transformation patterns using Azure & Databricks.
• Transform datasets into Parquet and Delta formats for analytics and AI use cases.
• Develop ETL/ELT pipelines and create Power BI visualisations for operational analytics.
• Optimize query performance across Spark, Azure SQL, and cloud storage.
• Collaborate within an Agile delivery team and uphold delivery standards.

Skills

Cloud proficiency

Communication

Agile delivery

Tools

Azure Data Factory

Databricks

SQL Server

Data Lake Storage

Power BI

Job description

Lead Data Engineer | Federal Government

About the Opportunity

• Join a dynamic, multi-disciplinary section driving critical enterprise analytics and modern data platforms within a secure Federal Government environment.
• Deliver high-impact operational analytics by designing and maintaining cutting-edge ingestion patterns, transformation solutions, and data visualisations using Azure and Databricks technologies.

What's on Offer

• Contract/Engagement: Initial 12-month contract + 1x 12-month extension option.
• Location & Flexibility: Canberra, ACT (Only)

Role & Responsibilities

• Design, build, and maintain automated ingestion and transformation patterns using modern cloud technologies (Azure & Databricks).
• Transform complex datasets into Parquet and Delta formats tailored for advanced analytics and AI use cases.
• Develop ETL/ELT data pipelines and create Power BI visualisations to support operational analytics and decision-making processes.
• Optimize query performance across distributed computing engines (Spark), Azure SQL, and cloud storage solutions.
• Collaborate within an Agile delivery team while providing quality reviews and constructive feedback to uplift delivery standards.

Skills & Experience

To be successful in this position, you will ideally bring:

• Technical Toolkit: Strong expertise in Azure hosted services (Data Factory, Databricks, SQL Server, Data Lake Storage, Azure ML), DevOps, Visual Studio, Power BI, and data formats like Parquet and Delta.
• Experience: 5+ years of experience as a Data Engineer, with proven expertise developing complex ETL/ELT processes in cloud environments and distributed computing engines (e.g., Spark).
• Core Capabilities: High productivity, ownership, and exceptional written and oral communication skills to engage and negotiate effectively with multi-disciplinary team members.

Eligibility & Clearance Requirements

• Security Clearance: Due to the nature of this environment, candidates must hold a valid Negative Vetting Level 1 (NV1) security clearance.