Lead Data Engineer - Big Data, Spark & Analytics

IT Alliance; Canberra; On-site; AUD 150,000 - 185,000; Full time

Job summary

IT Alliance is seeking a Lead Data Engineer in Canberra to design and oversee a federal data stack, including batch and streaming components. You will model and prepare data from diverse sources, and provide scalable solutions with a focus on performance and reliability.

You will work closely with inter-agency teams and stakeholders to translate data into actionable insights, deliver ongoing reports, and guide data architecture decisions within a federal government context.

Qualifications

• 3+ years experience researching, selecting and integrating a Big Data tech stack with batch and stream processing.
• Experience modelling, extracting, loading and analysing data from diverse sources (flat files, SQL, NoSQL).
• Ability to advise on scalability and performance improvements and work with cross‑agency stakeholders.

Responsibilities

• Interpret data and analyse results using statistical techniques.
• Provide ongoing reports and insights to inform decision making.
• Collaborate with internal and external stakeholders to ensure data quality and usability.

Skills

Spark

Elastic

Solr

Big Data

Batch Processing

Job description

IT Alliance is seeking a Lead Data Engineer in Canberra to design and oversee a federal data stack, including batch and streaming components. You will model and prepare data from diverse sources, and provide scalable solutions with a focus on performance and reliability.

You will work closely with inter-agency teams and stakeholders to translate data into actionable insights, deliver ongoing reports, and guide data architecture decisions within a federal government context.