Data Scientist

Calleo Australia; Sydney; Hybrid; AUD 120,000 - 160,000; Full time

Job summary

Calleo Australia is seeking a Data Scientist to leverage advanced AI, NLP and ML techniques to identify, extract and relate skills information from diverse data sources. You will work with a multidisciplinary team to design scalable analytics pipelines and repeatable processes for ongoing improvement.

Collaborating with taxonomy and policy experts, you will implement validation, model evaluation, and MLOps practices, shaping data-driven solutions across multi-city data environments.

Responsibilities

• Identify, extract, classify and relate skills information from structured and unstructured data sources.
• Develop, adapt and evaluate NLP, transformer-based and LLM approaches for skills extraction and text classification.
• Apply expertise in AI and GenAI frameworks to develop, test and optimise bespoke model solutions in GPU-enabled environments.
• Apply rigorous model evaluation and validation methodologies, including benchmark development, performance measurement and reproducibility.
• Design and enhance technical validation capabilities for transparent, repeatable model assessment.
• Collaborate with taxonomy, policy and subject matter experts to incorporate definitions, terminology, classification rules and validation requirements into workflows and AI-enabled solutions.
• Collaborate with Data Engineers to operationalise NLP and AI models through repeatable data processing, validation and model-serving pipelines.
• Apply software engineering and MLOps practices, including version control, testing, reproducibility, model lifecycle management and technical documentation.

Job description

About the Job

Our client is a Federal Government department that is responsible for helping people gain the skills and training they need to find and keep meaningful employment. The agency also oversees policies that promote safe workplaces for both employers and employees.

We are seeking a Data Scientist that will leverage advanced AI, NLP and machine learning techniques to identify, extract, classify, map and relate skills information from diverse structured and unstructured data sources. Working with the Lead Data Scientist and a multidisciplinary team of technical and policy specialists, the role will design and implement scalable analytical capabilities, data pipelines and repeatable processes to support the development, operationalisation and continual improvement.

Job Overview

• Identify, extract, classify and relate skills information from structured and unstructured data sources.
• Develop, adapt and evaluate natural language processing (NLP), transformer-based and Large Language Model (LLM) approaches for skills extraction, text classification, semantic similarity, clustering and entity resolution.
• Apply expertise in contemporary artificial intelligence (AI) and generative AI (GenAI) frameworks to develop, test and optimise bespoke model solutions, including within GPU-enabled computing environments.
• Apply rigorous model evaluation and validation methodologies, including benchmark development, performance measurement, error analysis and reproducibility practices.
• Design and enhance technical validation capabilities that support the transparent, repeatable and scalable assessment of model outputs, extracted skills and taxonomy recommendations.
• Collaborate with taxonomy, policy and subject matter experts to incorporate skills definitions, terminology, classification rules and validation requirements into analytical workflows and AI-enabled solutions.
• Collaborate with Data Engineers to operationalise NLP and AI models through repeatable data processing, validation and model-serving pipelines.
• Apply software engineering and machine learning operations (MLOps) practices, including version control, testing, reproducibility, model lifecycle management and technical documentation.

Job Location

Canberra / Sydney / Brisbane / Melbourne

Due to the nature of this role, this job is open to Australian Citizens only. Candidates who currently hold or able to obtain Federal Government Security Clearances are highly desirable.

Calleo is an equal opportunity employer, and we encourage applications from all people including Aboriginal and Torres Strait Islander people.