Data Scientist

Calleo; Canberra; On-site; AUD 120,000 - 180,000; Full time

Job summary

Calleo is seeking an NLP/AI specialist to extract and relate skills from diverse data sources, developing transformer-based solutions and evaluating model performance. The role involves GPU-enabled environments and close collaboration with subject matter experts on taxonomy and validation rules.

You'll work with data engineers to productionize NLP models and apply MLOps practices across the model lifecycle, from development to deployment, ensuring reproducibility and robust validation.

Qualifications

• Experience with NLP and transformer-based/LLM approaches.
• Proficient in model evaluation, benchmarking and reproducibility.
• Collaborate with SMEs to define skills taxonomy and validation rules.

Responsibilities

• Identify, extract, and relate skills from structured and unstructured data.
• Develop and evaluate NLP/LLM approaches for skill extraction and classification.
• Apply AI frameworks to build bespoke model solutions in GPU-enabled environments.
• Implement rigorous model evaluation and validation methodologies.
• Collaborate on taxonomy, policies and validation requirements in analytics workflows.
• Work with Data Engineers to operationalise NLP models and pipelines.
• Apply MLOps practices including version control, testing and model lifecycle management.

Skills

NLP

LLMs

Transformers

Text Classification

Entity Resolution

MLOps

GPU Computing

Model Evaluation

Tools

Python

Git

Docker

Kubernetes

PyTorch

TensorFlow

Job description

• Identify, extract, classify and relate skills information from structured and unstructured data sources.
• Develop, adapt and evaluate natural language processing (NLP), transformer-based and Large Language Model (LLM) approaches for skills extraction, text classification, semantic similarity, clustering and entity resolution.
• Apply expertise in contemporary artificial intelligence (AI) and generative AI (GenAI) frameworks to develop, test and optimise bespoke model solutions, including within GPU-enabled computing environments.
• Apply rigorous model evaluation and validation methodologies, including benchmark development, performance measurement, error analysis and reproducibility practices.
• Design and enhance technical validation capabilities that support the transparent, repeatable and scalable assessment of model outputs, extracted skills and taxonomy recommendations.
• Collaborate with taxonomy, policy and subject matter experts to incorporate skills definitions, terminology, classification rules and validation requirements into analytical workflows and AI-enabled solutions.
• Collaborate with Data Engineers to operationalise NLP and AI models through repeatable data processing, validation and model-serving pipelines.
• Apply software engineering and machine learning operations (MLOps) practices, including version control, testing, reproducibility, model lifecycle management and technical documentation.

Job Overview

• Identify, extract, classify and relate skills information from structured and unstructured data sources.
• Develop, adapt and evaluate natural language processing (NLP), transformer-based and Large Language Model (LLM) approaches for skills extraction, text classification, semantic similarity, clustering and entity resolution.
• Apply expertise in contemporary artificial intelligence (AI) and generative AI (GenAI) frameworks to develop, test and optimise bespoke model solutions, including within GPU-enabled computing environments.
• Apply rigorous model evaluation and validation methodologies, including benchmark development, performance measurement, error analysis and reproducibility practices.
• Design and enhance technical validation capabilities that support the transparent, repeatable and scalable assessment of model outputs, extracted skills and taxonomy recommendations.
• Collaborate with taxonomy, policy and subject matter experts to incorporate skills definitions, terminology, classification rules and validation requirements into analytical workflows and AI-enabled solutions.
• Collaborate with Data Engineers to operationalise NLP and AI models through repeatable data processing, validation and model-serving pipelines.
• Apply software engineering and machine learning operations (MLOps) practices, including version control, testing, reproducibility, model lifecycle management and technical documentation.

Job Location

Canberra / Sydney / Brisbane / Melbourne

Due to the nature of this role, this job is open to Australian Citizens only. Candidates who currently hold or able to obtain Federal Government Security Clearances are highly desirable.

Calleo is an equal opportunity employer, and we encourage applications from all people including Aboriginal and Torres Strait Islander people.

Follow Calleo on LinkedIn and visit our website to keep up to date on all our current job vacancies:

www.linkedin.com/company/calleoresourcing

www.calleo.com.au