Data Scientist: AI Evaluation & LLM Data Mastery

TELUS Digital AI Data Solutions; Mexico; On-site; PHP 851,948 - 2,129,870; Full time

Benefits offered by this job

Remote work

Global community

Flexible scheduling

Job summary

TELUS Digital is seeking a data scientist to steward data quality and interrogate model performance. You will design evaluation strategies for accuracy, helpfulness, and safety across large datasets, and transform raw text into optimized training data for large language models.

You will build automated scripts to monitor data consistency, uncover biases and plateaus, and provide statistical evidence to guide AI development. This role offers remote collaboration with a global community of experts.

Qualifications

• Bachelor's degree in data science, mathematics, statistics, physics or related field.
• English proficiency at least B1 (Intermediate).
• Native-level fluency in at least one language.
• Basic proficiency in data manipulation (Python, SQL, or Excel).

Responsibilities

• Architect and execute evaluation frameworks to measure model accuracy, helpfulness, and safety across large datasets.
• Perform advanced data-wrangling to transform raw text into optimized training sets for Large Language Models (LLMs).
• Detect and visualize trends in model failures, providing insights to guide AI training.
• Develop automated scripts to monitor consistency of human-annotated data and ensure data quality standards.

Skills

Python

SQL

Data analysis

Education

Bachelor's degree in Data Science, Mathematics, Statistics, Physics, or related technical field

Job description

TELUS Digital is seeking a data scientist to steward data quality and interrogate model performance. You will design evaluation strategies for accuracy, helpfulness, and safety across large datasets, and transform raw text into optimized training data for large language models.

You will build automated scripts to monitor data consistency, uncover biases and plateaus, and provide statistical evidence to guide AI development. This role offers remote collaboration with a global community of experts.