Lead Data Engineer

IT Alliance; Canberra; On-site; AUD 150,000 - 185,000; Full time

Job summary

IT Alliance is seeking a Lead Data Engineer in Canberra to design and oversee a federal data stack, including batch and streaming components. You will model and prepare data from diverse sources, and provide scalable solutions with a focus on performance and reliability.

You will work closely with inter-agency teams and stakeholders to translate data into actionable insights, deliver ongoing reports, and guide data architecture decisions within a federal government context.

Qualifications

• 3+ years experience researching, selecting and integrating a Big Data tech stack with batch and stream processing.
• Experience modelling, extracting, loading and analysing data from diverse sources (flat files, SQL, NoSQL).
• Ability to advise on scalability and performance improvements and work with cross‑agency stakeholders.

Responsibilities

• Interpret data and analyse results using statistical techniques.
• Provide ongoing reports and insights to inform decision making.
• Collaborate with internal and external stakeholders to ensure data quality and usability.

Skills

Spark

Elastic

Solr

Big Data

Batch Processing

Job description

One of our Federal Government clients is looking for Lead Data Engineer in Canberra.

We are looking for the following Skills/Experience:

• 3+ years demonstrated experience successfully researching, selecting and integrating a Big Data technology stack including batch and stream processing tools such as Spark and indexing technologies such as Elastic and Solr.
• Experience modelling, extracting, loading and analysing data from a wide range of sources including flat files, SQL and nosql data and providing advice about ways to enhance scalability and system performance.
• Experience forming and maintaining strong working relationships with internal and external stakeholders including inter-disciplinary and inter-agency liaison.
• Interpret data, analyse results using statistical techniques and provide ongoing reports.

Note – We are equal employment opportunity provider and encourage applications from people with disability. Please let us know if you need special assistance for this job application.