Production Data Scientist: R, Spark & Azure Databricks

Recruitment Hive

Sydney

On-site

AUD 120,000 - 180,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

The Recruitment Hive is seeking a Data Scientist for a large Federal Government organisation to advance production-grade data solutions using R, Spark, and Databricks in an Australian context. You will analyse complex models, implement tests, and collaborate with cross-disciplinary teams to ensure robust, scalable outcomes.

The role focuses on refactoring microsimulation models, optimising performance, maintaining data pipelines with Azure Databricks and Delta Lake, and applying software

Qualifications

  • Experience delivering complex models into production.
  • Designing and implementing scenario testing methodologies.
  • Optimising computational performance and scalability for large-scale data processing.
  • Solid understanding of software engineering practices, including automated testing, modular code design, and version control.

Responsibilities

  • Conduct code analysis and peer review of a microsimulation model, refactoring, optimisation, and ensuring code readiness for operational use.
  • Optimise compute usage and improve performance across Spark jobs and model workloads.
  • Maintain scalable data pipelines and workflows using Azure Databricks, Delta Lake, and related services.
  • Implement best practice data engineering standards, including version control, testing frameworks, logging, monitoring, and error handling processes.
  • Collaborate closely with other data scientists, analysts, engineers and domain experts to understand model structure and ensure accurate, performant implementation.

Skills

R programming
Code comprehension
Unit testing
Optimization

Tools

Azure Databricks
Delta Lake
Spark
Git

Job description

The Recruitment Hive is seeking a Data Scientist for a large Federal Government organisation to advance production-grade data solutions using R, Spark, and Databricks in an Australian context. You will analyse complex models, implement tests, and collaborate with cross-disciplinary teams to ensure robust, scalable outcomes.

The role focuses on refactoring microsimulation models, optimising performance, maintaining data pipelines with Azure Databricks and Delta Lake, and applying software

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Statistical Programmer – R & Databricks (AU)
Senior Statistical Programmer – R & Databricks (AU)

face2face Recruitment • Melbourne

Hybrid
AUD 120,000 - 180,000
Production Data Scientist – Azure Databricks & R
Production Data Scientist – Azure Databricks & R

Calleo • Melbourne

Hybrid
AUD 120,000 - 150,000
Data Scientist - R & Spark Production Microsimulation
Data Scientist - R & Spark Production Microsimulation

Whizdom • Canberra

On-site
AUD 70,000 - 110,000
Data Scientist
Data Scientist

Whizdom • Canberra

On-site
AUD 70,000 - 110,000
Data Scientist
Data Scientist

Recruitment Hive • Sydney

On-site
AUD 120,000 - 180,000
Data Scientist
Data Scientist

Calleo • Melbourne

Hybrid
AUD 120,000 - 150,000
Data Engineer
Data Engineer

XPT Software Australia Pty Ltd • Sydney

On-site
AUD 180,000 - 230,000
Senior Statistical Programmer
Senior Statistical Programmer

face2face Recruitment • Melbourne

Hybrid
AUD 120,000 - 180,000
Senior Data Engineer — AI in Production (Databricks, Hybrid)
Senior Data Engineer — AI in Production (Databricks, Hybrid)

HorizonOne Recruitment Pty • Canberra

Hybrid
AUD 120,000 - 150,000
Hybrid working across Australia
Contract role with extension option
Data Engineer
Data Engineer

XPT Software • Canberra

On-site
AUD 150,000 - 190,000
Top locations