Production Data Scientist – Azure Databricks & R

Calleo

Melbourne

Hybride

AUD 120 000 - 150 000

Plein temps

Il y a 7 jours
Soyez parmi les premiers à postuler

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

Calleo is seeking an experienced Data Scientist to modernise and operationalise a microsimulation capability for production deployment within Azure Databricks and Delta Lake. You will optimise Spark workloads, design scalable data pipelines, and implement automated testing and version control while collaborating with data scientists, engineers and business stakeholders.

The role requires strong R programming expertise and a solid understanding of software engineering principles, with security

Qualifications

  • Strong experience building analytical solutions in R and deploying models to production.
  • Experience designing testing frameworks, validation processes and repeatable scenario testing.
  • Solid knowledge of Apache Spark and large-scale data processing environments.
  • Understanding of software engineering principles including modular design, automated testing and version control.
  • Excellent stakeholder engagement and collaboration skills.

Responsabilités

  • Analyse, review and optimise a complex microsimulation model for production deployment.
  • Refactor and improve code quality, performance and maintainability.
  • Optimise Spark workloads and improve computational efficiency across large-scale processing environments.
  • Develop and maintain scalable data pipelines using Azure Databricks, Delta Lake and associated technologies.
  • Implement best-practice software engineering and data engineering standards, including automated testing, version control, monitoring and error handling.
  • Work closely with data scientists, analysts, engineers and business stakeholders to ensure accurate and effective model implementation.
  • Produce technical documentation, operational procedures and architecture artefacts.

Connaissances

Stakeholder engagement
Communication

Outils

Azure Databricks
Azure Data Factory
Delta Lake
Unity Catalog
Azure Storage
Spark

Description du poste

Calleo is seeking an experienced Data Scientist to modernise and operationalise a microsimulation capability for production deployment within Azure Databricks and Delta Lake. You will optimise Spark workloads, design scalable data pipelines, and implement automated testing and version control while collaborating with data scientists, engineers and business stakeholders.

The role requires strong R programming expertise and a solid understanding of software engineering principles, with security

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Production Data Scientist: R, Spark & Azure Databricks
Production Data Scientist: R, Spark & Azure Databricks

Recruitment Hive • Sydney

Sur place
AUD 120 000 - 180 000
Data Engineer
Data Engineer

XPT Software • Sydney

Sur place
AUD 140 000 - 190 000
Data Scientist - R & Spark Production Microsimulation
Data Scientist - R & Spark Production Microsimulation

Whizdom • Canberra

Sur place
AUD 70 000 - 110 000
Senior Statistical Programmer – R & Databricks (AU)
Senior Statistical Programmer – R & Databricks (AU)

face2face Recruitment • Melbourne

Hybride
AUD 120 000 - 180 000
Data Engineer
Data Engineer

XPT Software • Canberra

Sur place
AUD 150 000 - 190 000
Data Engineer
Data Engineer

XPT Software Australia Pty Ltd • Sydney

Sur place
AUD 180 000 - 230 000
Data Scientist
Data Scientist

Calleo • Melbourne

Hybride
AUD 120 000 - 150 000
Lead Data Platform Engineer — Azure Databricks, Hybrid
Lead Data Platform Engineer — Azure Databricks, Hybrid

Shift • Sydney

Hybride
AUD 150 000 - 190 000
Hybrid work policy
Parental leave up to 26 weeks
Strategy Week
+2
Senior Azure Databricks Data Engineer (Lakehouse)
Senior Azure Databricks Data Engineer (Lakehouse)

XPT Software Australia Pty Ltd • Sydney

Sur place
AUD 180 000 - 230 000
Senior Data Engineer - Azure Databricks Platform Lead
Senior Data Engineer - Azure Databricks Platform Lead

Shift Financial • Sydney

Hybride
AUD 140 000 - 190 000
Parental leave
Hybrid working
Strategy Week
+2
Lieux principaux