Remote Data Scientist: AI Evaluation & LLM Quality

Jazmin Par; United States; Remote; USD 28,000 - 69,000; Full time

Benefits offered by this job

Remote work

Global AI community

Hands-on AI research

Flexible engagement

Job summary

TELUS Digital is seeking a data scientist to safeguard the quality of data powering AI. You will design evaluation frameworks to measure model accuracy, safety, and helpfulness across large datasets and perform advanced data-wrangling to prepare training sets for LLMs.

You will detect and visualize trends in model failures, providing actionable insights for ongoing AI improvement, and develop automated scripts to ensure the consistency of human-annotated data across projects.

Qualifications

• Bachelor’s degree in data science, mathematics, statistics, physics, or related field.
• English proficiency at least B1 to communicate data trends.
• Native-level fluency in at least one language.
• Basic proficiency in data manipulation (Python, SQL, or Excel).

Responsibilities

• Architect and execute evaluation frameworks for model accuracy, helpfulness, and safety.
• Perform data-wrangling to transform raw text into training sets for LLMs.
• Detect and visualize trends in model failures, guiding AI training.
• Develop automated scripts to monitor the quality of human-annotated data.

Skills

English proficiency

Language fluency

Education

Bachelor's degree in a technical field

Tools

Python

SQL

Excel

Job description

TELUS Digital is seeking a data scientist to safeguard the quality of data powering AI. You will design evaluation frameworks to measure model accuracy, safety, and helpfulness across large datasets and perform advanced data-wrangling to prepare training sets for LLMs.

You will detect and visualize trends in model failures, providing actionable insights for ongoing AI improvement, and develop automated scripts to ensure the consistency of human-annotated data across projects.