Lead Data Engineer – Azure | NV1 | Canberra

Pinaka; Canberra; Hybrid; AUD 120,000 - 150,000; Full time

Job summary

Pinaka is recruiting a Lead Data Engineer to work with the Department of Agriculture, Fisheries and Forestry in Canberra on hybrid arrangements. The role focuses on ETL/ELT development, data movement, and advanced visualisations to support decision making across the department.

The successful candidate will lead design, development and testing of data ingestion and transformation, and will collaborate with engineering, storage and analytics teams in a cloud environment leveraging Azure

Qualifications

• Demonstrated experience developing ETL/ELT processes for complex data movement and visualisations.
• Experience optimising data for query performance in cloud engines.
• Experience working with Engineering, Storage and Analytics services in cloud infrastructure.

Responsibilities

• Be responsive, flexible, and work collaboratively as part of an agile team.
• Build and maintain automated ingest and transformation patterns and data solutions.
• Support project teams to achieve departmental priorities and deliver quality data products.
• Collaborate on Azure Data Factory, Databricks, SQL Server, and Data Lake Storage.
• Develop data visualisations using Power BI and guide data preparation for analytics.

Skills

ETL/ELT development

Query performance tuning

Cloud infra collaboration

Tools

Azure Data Factory

Databricks

Power BI

Job description

Australian citizenship required. Must be able to obtain Negative Vetting Level 1 security clearance.
Location: Canberra (Hybrid).

Lead Data Engineer

Australian citizenship required. Must be able to obtain Negative Vetting Level 1 security clearance.
Location: Canberra (Hybrid).

What to Submit

• A tailored resume in docx format
• Individual responses to each criterion (maximum 3000 characters per criterion)

RFQ Details

• RFQ ID: LH-08070
• Agency: Department of Agriculture, Fisheries and Forestry
• Closing Date: Tuesday, 20 October 2026 – 11:59pm (Canberra time)
• Estimated Start Date: Monday, 09 November 2026
• Initial Contract Duration: 12 months
• Extension Term: 12 months
• Number of Extensions: 2
• Experience Level: Lead - EL1 equivalent
• Security Clearance: Must be able to obtain Negative Vetting Level 1 security clearance
• Location of Work: ACT
• Working Arrangements: Hybrid. Most of the section is located at Agriculture House in Canberra CBD. The standard expectation is for staff to attend the office three (3) working days each week. The section is supportive of flexible arrangements and consideration will be made to accommodate individual and collaboration needs. In-person attendance at important Agile ceremonies (currently held quarterly) and other important team / section events is a requirement.
• Maximum Hours: 40 hours per week

Job Details

The Department of Agriculture, Fisheries and Forestry (DAFF) is looking for a Data Engineer to join its Enterprise Analytics and Technology Services (EATS) section to work across its data and analytics platforms. We are seeking candidates with strong experience in developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes, and /or the development of data products and complex data visualisations.
The role will be responsible for design, development and testing activities across several data movement, data transformation, and data visualisation processes within DAFF. The data movement and transformation processes focus on the preparation of data for use in decision making processes across the department, utilising modern cloud technology (Azure & Databricks) to enable operational analytics use cases.
To be successful in the role, you must have a strong work ethic including taking ownership, providing leadership, having a high level of productivity, and working with a multi-disciplinary team in an Agile development environment. You must have suitable qualifications or training in data engineering techniques and at least 5 years’ experience working as a data engineer.
Candidates must hold a valid Negative Vetting Level 1 security clearance or be willing and eligible to obtain one. Commencement within the section is contingent on the candidate obtaining a Baseline clearance. Please provide your CSID on your resume/CV (if known).

Key Duties and Responsibilities

• Be responsive, flexible, and work collaboratively as part of an agile team.
• Strong relationship building, and negotiation skills.
• Strong written and oral communication skills.
• Creating and maintaining automated ingest and transformation patterns and frameworks. Designing, building and maintaining data ingest and transformation solutions to meet current and emerging needs.
• Assisting project teams achieve objectives that align with departmental, divisional, and program priorities.
• Supporting data engineers in delivery teams, through regular quality reviews and constructive feedback on utilising data assets to produce quality data products.
• Azure hosted services including:
  • Data Integration - Data Factory, SQL Server Integration Services and/or Databricks
  • Data Store - SQL Server and/or Data Lake Storage
  • Analytics - Azure Databricks, Azure Machine Learning, ArcGIS Enterprise
• Development tools – DevOps, Visual Studio
• Data technology solutions – sourcing (Oracle, Ingres, Azure, SQL Server), automated ingestion
• Data Preparation:
  • Transformation of data into formats tailored for advanced analytics and AI use cases – Parquet and/or Delta
• Data Visualisation:
  • Analyse and interpret complex data sets, and to identify trends and patterns.
  • Design principles to create appropriate visualisations for target audience.
  • Visualisation tools - Power BI.

Technical Skills

See above.

Selection Criteria

Essential criteria

• Demonstrated experience developing ETL/ELT processes for complex and/or large data movement, transformation and/or visualisations, particularly in a cloud environment.
  50%
• Experience preparing data optimised for query performance in cloud computed engines.
  

  E.g.

  • Distributed computing engines (Spark)
  • Graph Databases
  • Azure
  
  SQL
  25%
• Experience working with Engineering, Storage and Analytics services in cloud infrastructure.
  25%

Desirable criteria

• Experience working with Azure Data Factory and Databricks.
• Experience/Knowledge of working with Data Lake and Lakehouses.

Why choose Pinaka

We know the government ICT market and we keep things straightforward. We take time to understand your background, your goals and the type of role that suits you. We believe transparency is about more than rates and our margins are fair and always disclosed.

What you can expect from us...

• Fair, disclosed margins
• Clear communication at every stage
• Honest advice on fit and competitiveness
• Visibility on submissions and process status
• A professional and respectful experience

How you are paid...

You choose what's best for you.

• PAYG through Pinaka
• Third-party payroll
• Self-employed (own ABN)
  With a single, transparent and fixed margin, we ensure compliance to all state and payroll laws. So that is one less thing for you to worry about.

BYO CONTRACT

Already in a role but not happy with the setup?
Port in your contract to Pinaka for a simpler and more transparent experience. We also have some exciting limited time offers on top of the incredible margins we offer.https://pinaka.com.au/bring-your-own-contract/

BETTER TOGETHER

Our referral program for people who introduce strong candidates to us.
Refer a friend - Earn $1/hr per successful referral as long as you both with us. Refer as many friends as you want; no caps.

Be careful - Don’t provide your bank or credit card details when applying for jobs. Don't transfer any money or complete suspicious online surveys. If you see something suspicious, report this job ad .