Data Scientist

Whizdom

Canberra

On-site

AUD 70,000 - 110,000

Full time

8 days ago

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Whizdom is seeking a Data Scientist to help transition a complex microsimulation model into a robust, scalable production environment. You will work with R for custom functions and Python for pipelines, deploying in Databricks with Delta Lake and Azure services.

The role requires production-grade validation, testing, and collaboration with cross-functional teams to ensure governance and performance. This is a 7-month contract based in Australia.

Qualifications

  • Strong experience writing custom functions in R and ability to understand complex code.
  • Experience delivering complex models into production with validation and unit testing.
  • Designing and implementing scenario testing methodologies and repeatable testing processes.
  • Proficiency in Spark and scalable data processing for large datasets.
  • Solid software engineering practices: automated testing, modular code, and version control.
  • Ability to collaborate with both technical and non-technical stakeholders.

Responsibilities

  • Conduct code analysis and peer review of the microsimulation model, including refactoring, optimisation, and preparing for production use.
  • Optimise compute usage and improve performance across Spark jobs and model workloads.
  • Maintain scalable data pipelines using Azure Databricks and Delta Lake.
  • Implement best practice data engineering standards including version control, testing, logging, monitoring, and error handling.
  • Collaborate with data scientists, analysts, engineers and domain experts to understand model structure and ensure accurate implementation.
  • Coordinate with cloud/platform teams to ensure deployed product meets organisational standards and platform capabilities.
  • Document workflows, architecture, model dependencies, and operational procedures.

Skills

Custom R functions
Production deployment
Scenario testing
Spark
Data engineering
Version control

Tools

Azure Databricks
Delta Lake
Unity Catalog
Python

Job description

Seeking a Data Scientist with experience with Advanced skills in writing custom R functions.

The team seeks a skilled Data Scientist to assist with transitioning a complex microsimulation model into a robust, scalable, and well-governed production environment.

The production environment is in Databricks and needs to support streamlined scenario testing input.

Advanced skills in writing custom R functions are essential for the successful candidate, as the microsimulation model is written in R with supporting pipelines in Python.

Key Responsibilities
  • Conduct code analysis and peer review of a microsimulation model, including refactoring, optimisation, and ensuring code readiness for operational use.
  • Optimise compute usage and improve performance across Spark jobs and model workloads.
  • Maintain scalable data pipelines and workflows using Azure Databricks, Delta Lake, and related services.
  • Implement best practice data engineering standards, including version control, testing frameworks, logging, monitoring, and error handling processes.
  • Collaborate closely with other data scientists, analysts, engineers and domain experts to understand model structure and ensure accurate, performant implementation.
  • Work with cloud and platform support teams to ensure the deployed product aligns with organisational standards, operational requirements, and platform capabilities.
  • Document workflows, architecture, model dependencies, and operational procedures.
Essential Skills
  • Strong experience writing custom functions using R and the ability to understand complex code.
  • Experience in delivering complex models into production, including validation and unit testing.
  • Demonstrated capability in designing and implementing scenario testing methodologies and repeatable testing processes.
  • Proficiency in Spark and related data engineering technologies, with experience optimising computational performance and scalability for large-scale data processing.
  • Solid understanding of software engineering practices, including automated testing, modular code design, and version control.
  • Ability to work collaboratively with technical and non-technical stakeholders.
Desirable skills
  • Familiarity with Azure Data Factory, Azure Storage, or Unity Catalog.
  • Experience working with labour market data, ABS reports and ABS TableBuilder.
  • Experience in the public sector or a regulated environment.
Contract

7 Months Contract

Security Required

BaselineSecurity clearance required

Location

Canberra, Sydney, Melbourne, Adelaide, Perth, Hobart and Brisbane

Closing date

Friday 13 November 2026

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Scientist
Data Scientist

Recruitment Hive • Sydney

On-site
AUD 120,000 - 180,000
Senior Statistical Programmer
Senior Statistical Programmer

face2face Recruitment • Melbourne

Hybrid
AUD 120,000 - 180,000
Data Scientist
Data Scientist

Calleo • Melbourne

Hybrid
AUD 120,000 - 150,000
Data Scientist - R & Spark Production Microsimulation
Data Scientist - R & Spark Production Microsimulation

Whizdom • Canberra

On-site
AUD 70,000 - 110,000
Senior Statistical Programmer – R & Databricks (AU)
Senior Statistical Programmer – R & Databricks (AU)

face2face Recruitment • Melbourne

Hybrid
AUD 120,000 - 180,000
Production Data Scientist: R, Spark & Azure Databricks
Production Data Scientist: R, Spark & Azure Databricks

Recruitment Hive • Sydney

On-site
AUD 120,000 - 180,000
Lead Data Scientist
Lead Data Scientist

Talenza • Brisbane

Hybrid
AUD 140,000 - 190,000
Data Analyst/ Data Scientist
Data Analyst/ Data Scientist

HorizonOne Recruitment • Canberra

Hybrid
AUD 90,000 - 120,000
Senior Data Scientist
Senior Data Scientist

IT Alliance • Brisbane

On-site
AUD 130,000 - 170,000
Data Scientist
Data Scientist

Australian Taxation Office • Adelaide

On-site
AUD 80,000 - 120,000
Top locations