Remote AI Data Scientist — Model Evaluation & Quality

Island Jobs; Australia; Remote; AUD 39,000 - 98,000; Full time

Job summary

TELUS Digital seeks a data scientist to rigorously diagnose model performance, uncover biases, and quantify improvements. You will evaluate accuracy, helpfulness, and safety across large datasets, and preprocess data for large language models.

Role emphasizes automated monitoring of data quality and visualization of failure modes to inform ongoing AI training and evaluation. Remote collaboration with a global community is offered, paid on an hourly basis.

Qualifications

• Bachelor’s degree in Data Science, Mathematics, Statistics, Physics, or related technical field.
• English proficiency at least B1 to communicate data trends.
• Native-level fluency in at least one language.
• Basic proficiency in data manipulation (Python, SQL, or Excel).

Responsibilities

• Architect and execute evaluation frameworks to measure model accuracy, helpfulness, and safety across massive datasets.
• Perform advanced data-wrangling to transform raw text into optimized training sets for LLMs.
• Detect and visualize trends in model failures and provide actionable insights for AI training.
• Develop automated scripts to monitor the quality of human-annotated data.

Skills

Python

SQL

Excel

Education

Bachelor’s degree in Data Science or related field

Job description

TELUS Digital seeks a data scientist to rigorously diagnose model performance, uncover biases, and quantify improvements. You will evaluate accuracy, helpfulness, and safety across large datasets, and preprocess data for large language models.

Role emphasizes automated monitoring of data quality and visualization of failure modes to inform ongoing AI training and evaluation. Remote collaboration with a global community is offered, paid on an hourly basis.