Data Scientist

Calleo; Sydney; On-site; AUD 120,000 - 180,000; Full time

Job summary

CALLEO is seeking a Data Scientist to leverage AI, NLP and ML to extract and relate skills from diverse data sources, collaborating with a multidisciplinary team of policy and technical specialists.

You will design scalable analytics capabilities, data pipelines and repeatable processes to support development, operationalisation and continual improvement of AI solutions, including GenAI, across GPU-enabled environments.

Qualifications

• Identify, extract, classify and relate skills information from structured and unstructured data sources.
• Develop NLP, transformer‑based and LLM approaches for skills extraction and text classification.
• Apply GenAI frameworks to develop, test and optimise bespoke model solutions in GPU-enabled environments.
• Apply rigorous evaluation and validation methodologies, including benchmarks, performance measurement and reproducibility.
• Collaborate with taxonomy, policy and subject matter experts to incorporate definitions and validation requirements into workflows.

Responsibilities

• Identify, extract, classify and relate skills information from structured and unstructured data sources.
• Develop NLP, transformer-based and LLM approaches for skills extraction, text classification, semantic similarity, clustering and entity resolution.
• Apply GenAI frameworks to develop, test and optimise bespoke model solutions, including in GPU-enabled computing environments.
• Apply rigorous model evaluation and validation methodologies, including benchmark development, performance measurement, error analysis and reproducibility practices.
• Design and enhance technical validation capabilities to support scalable assessment of model outputs.
• Collaborate with taxonomy, policy and subject matter experts to incorporate skills definitions and validation requirements into analytical workflows.
• Collaborate with Data Engineers to operationalise NLP and AI models through repeatable data processing and model-serving pipelines.
• Apply software engineering and MLOps practices, including version control, testing, reproducibility and model lifecycle management.

Skills

NLP

LLM

GenAI

MLOps

Model evaluation

GPU computing

Job description

About the Job

Our client is a Federal Government department that is responsible for helping people gain the skills and training they need to find and keep meaningful employment. The agency also oversees policies that promote safe workplaces for both employers and employees.

We are seeking a Data Scientist that will leverage advanced AI, NLP and machine learning techniques to identify, extract, classify, map and relate skills information from diverse structured and unstructured data sources. Working with the Lead Data Scientist and a multidisciplinary team of technical and policy specialists, the role will design and implement scalable analytical capabilities, data pipelines and repeatable processes to support the development, operationalisation and continual improvement.

Job Overview

• Identify, extract, classify and relate skills information from structured and unstructured data sources.


• Develop, adapt and evaluate natural language processing (NLP), transformer-based and Large Language Model (LLM) approaches for skills extraction, text classification, semantic similarity, clustering and entity resolution.


• Apply expertise in contemporary artificial intelligence (AI) and generative AI (GenAI) frameworks to develop, test and optimise bespoke model solutions, including within GPU-enabled computing environments.


• Apply rigorous model evaluation and validation methodologies, including benchmark development, performance measurement, error analysis and reproducibility practices.


• Design and enhance technical validation capabilities that support the transparent, repeatable and scalable assessment of model outputs, extracted skills and taxonomy recommendations.


• Collaborate with taxonomy, policy and subject matter experts to incorporate skills definitions, terminology, classification rules and validation requirements into analytical workflows and AI-enabled solutions.


• Collaborate with Data Engineers to operationalise NLP and AI models through repeatable data processing, validation and model-serving pipelines.


• Apply software engineering and machine learning operations (MLOps) practices, including version control, testing, reproducibility, model lifecycle management and technical documentation.

Job Location

Canberra / Sydney / Brisbane / Melbourne

Due to the nature of this role, this job is open to Australian Citizens only. Candidates who currently hold or able to obtain Federal Government Security Clearances are highly desirable.

Calleo is an equal opportunity employer, and we encourage applications from all people including Aboriginal and Torres Strait Islander people.