Data Scientist - R & Spark Production Microsimulation

Whizdom

Canberra

On-site

AUD 70,000 - 110,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Whizdom is seeking a Data Scientist to help transition a complex microsimulation model into a robust, scalable production environment. You will work with R for custom functions and Python for pipelines, deploying in Databricks with Delta Lake and Azure services.

The role requires production-grade validation, testing, and collaboration with cross-functional teams to ensure governance and performance. This is a 7-month contract based in Australia.

Qualifications

  • Strong experience writing custom functions in R and ability to understand complex code.
  • Experience delivering complex models into production with validation and unit testing.
  • Designing and implementing scenario testing methodologies and repeatable testing processes.
  • Proficiency in Spark and scalable data processing for large datasets.
  • Solid software engineering practices: automated testing, modular code, and version control.
  • Ability to collaborate with both technical and non-technical stakeholders.

Responsibilities

  • Conduct code analysis and peer review of the microsimulation model, including refactoring, optimisation, and preparing for production use.
  • Optimise compute usage and improve performance across Spark jobs and model workloads.
  • Maintain scalable data pipelines using Azure Databricks and Delta Lake.
  • Implement best practice data engineering standards including version control, testing, logging, monitoring, and error handling.
  • Collaborate with data scientists, analysts, engineers and domain experts to understand model structure and ensure accurate implementation.
  • Coordinate with cloud/platform teams to ensure deployed product meets organisational standards and platform capabilities.
  • Document workflows, architecture, model dependencies, and operational procedures.

Skills

Custom R functions
Production deployment
Scenario testing
Spark
Data engineering
Version control

Tools

Azure Databricks
Delta Lake
Unity Catalog
Python

Job description

Whizdom is seeking a Data Scientist to help transition a complex microsimulation model into a robust, scalable production environment. You will work with R for custom functions and Python for pipelines, deploying in Databricks with Delta Lake and Azure services.

The role requires production-grade validation, testing, and collaboration with cross-functional teams to ensure governance and performance. This is a 7-month contract based in Australia.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Production Data Scientist: R, Spark & Azure Databricks
Production Data Scientist: R, Spark & Azure Databricks

Recruitment Hive • Sydney

On-site
AUD 120,000 - 180,000
Data Scientist
Data Scientist

Whizdom • Canberra

On-site
AUD 70,000 - 110,000
Senior Statistical Programmer – R & Databricks (AU)
Senior Statistical Programmer – R & Databricks (AU)

face2face Recruitment • Melbourne

Hybrid
AUD 120,000 - 180,000
Production Data Scientist – Azure Databricks & R
Production Data Scientist – Azure Databricks & R

Calleo • Melbourne

Hybrid
AUD 120,000 - 150,000
Data Scientist
Data Scientist

Recruitment Hive • Sydney

On-site
AUD 120,000 - 180,000
Data Scientist: Production-Ready ML & Data Engineering
Data Scientist: Production-Ready ML & Data Engineering

WSP Global Inc. • Western Australia

On-site
AUD 100,000 - 150,000
Flexible work arrangements
Learning & career development
Collaborative culture
+1
Data Scientist
Data Scientist

Calleo • Melbourne

Hybrid
AUD 120,000 - 150,000
Senior Statistical Programmer
Senior Statistical Programmer

face2face Recruitment • Melbourne

Hybrid
AUD 120,000 - 180,000
Data Engineer: Microsoft Fabric & PySpark Specialist
Data Engineer: Microsoft Fabric & PySpark Specialist

The HR Ally • Melbourne

On-site
AUD 129,000 - 221,000
Senior Data Engineer (Databricks, Data Modeling)
Senior Data Engineer (Databricks, Data Modeling)

EPAM Systems • Australia

On-site
AUD 150,000 - 200,000
Top locations