French-Language LLM Evaluation Specialist

Crossing Hurdles

Canada

On-site

CAD 60,000 - 80,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

A leading tech evaluation company in Canada seeks an AI Evaluation Specialist to assess LLM-generated responses for accuracy and relevance. The ideal candidate will be fluent in French and proficient in English, with a background in analytical fields. Responsibilities include fact-checking, annotating AI response strengths and weaknesses, and ensuring adherence to guidelines. This role requires strong writing skills and attention to detail, making it suitable for candidates with experience in research or analytics.

Qualifications

  • Fluent in French (ILR 5 / CEFR C2) and proficient in English.
  • Experience with LLMs and understanding of their practical applications.
  • Ability to provide structured feedback on AI outputs.
  • Ability to work across varied topics and evolving requirements.

Responsibilities

  • Evaluate LLM-generated responses for accuracy and relevance.
  • Perform fact-checking using reliable sources.
  • Create quality evaluation data by annotating AI responses.
  • Assess reasoning quality and adherence to guidelines.

Skills

Native-level French fluency
Strong English proficiency
Experience with large language models
Excellent writing skills
Strong attention to detail
Analytical thinking

Education

Background in research, policy, analytics, linguistics, or engineering

Job description

A leading tech evaluation company in Canada seeks an AI Evaluation Specialist to assess LLM-generated responses for accuracy and relevance. The ideal candidate will be fluent in French and proficient in English, with a background in analytical fields. Responsibilities include fact-checking, annotating AI response strengths and weaknesses, and ensuring adherence to guidelines. This role requires strong writing skills and attention to detail, making it suitable for candidates with experience in research or analytics.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM Evaluation Specialist: French and English
LLM Evaluation Specialist: French and English

Crossing Hurdles • Canada

On-site
CAD 65,000 - 90,000
Teacher | $36.16/hr Remote
Teacher | $36.16/hr Remote

Crossing Hurdles • Canada

On-site
CAD 60,000 - 80,000
Writer | $36.16/hr Remote
Writer | $36.16/hr Remote

Crossing Hurdles • Canada

On-site
CAD 65,000 - 90,000
AI Legal Research Evaluator (Part-Time)
AI Legal Research Evaluator (Part-Time)

Mercor • Montreal

Remote
CAD 152,000 - 190,000
Researcher - LLMs
Researcher - LLMs

Huawei Technologies Canada Co., Ltd. • Montreal

On-site
CAD 90,000 - 130,000
AI Engineer: LLM Agents & Product Insights
AI Engineer: LLM Agents & Product Insights

OpenReplay • Quebec

On-site
CAD 90,000 - 150,000
AI Developer: Generative AI & LLMs Specialist
AI Developer: Generative AI & LLMs Specialist

LuxeTech Inc. • Canada

On-site
CAD 80,000 - 100,000
Linguistic AI Auditor - French From Canada
Linguistic AI Auditor - French From Canada

Softechub • Montreal

On-site
CAD 55,000 - 75,000
Bilingual Legal Research Associate – AI‑Driven Legal Tech
Bilingual Legal Research Associate – AI‑Driven Legal Tech

LawVo • Toronto

Remote
CAD 60,000 - 90,000
Flexible work environment
Growth opportunities in a fast-growing startup
Linguistic AI Auditor - French From Canada
Linguistic AI Auditor - French From Canada

RWS TrainAI • Montreal

Remote
CAD 39,000 - 55,000