LLM Evaluation Specialist: French and English

Crossing Hurdles

Canada

On-site

CAD 65,000 - 90,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

A leading evaluation firm in Canada is seeking an experienced evaluator to assess the accuracy and relevance of LLM-generated responses. The ideal candidate will have native-level fluency in French, strong English proficiency, and proven experience with large language models. Responsibilities include evaluating response quality, fact-checking, and creating structured feedback. Candidates should possess excellent writing skills and analytical thinking, and be able to work across various domains. This role offers competitive compensation and the opportunity to contribute to AI evaluations.

Qualifications

  • Native-level or near-native fluency in French with strong English proficiency.
  • Proven experience using large language models.
  • Excellent writing skills and ability to provide structured feedback.
  • Strong attention to detail and analytical thinking.
  • Ability to work across multiple topics and domains.

Responsibilities

  • Evaluate LLM-generated responses for accuracy, relevance, and effectiveness.
  • Perform fact-checking using reliable sources and tools.
  • Create high-quality evaluation data by annotating responses.
  • Assess reasoning quality, tone, clarity, and completeness of outputs.
  • Ensure responses follow expected conversational behavior and guidelines.

Skills

Fluency in French
Writing skills
Attention to detail
Analytical thinking
Experience with large language models

Job description

A leading evaluation firm in Canada is seeking an experienced evaluator to assess the accuracy and relevance of LLM-generated responses. The ideal candidate will have native-level fluency in French, strong English proficiency, and proven experience with large language models. Responsibilities include evaluating response quality, fact-checking, and creating structured feedback. Candidates should possess excellent writing skills and analytical thinking, and be able to work across various domains. This role offers competitive compensation and the opportunity to contribute to AI evaluations.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

French-Language LLM Evaluation Specialist
French-Language LLM Evaluation Specialist

Crossing Hurdles • Canada

On-site
CAD 60,000 - 80,000
Teacher | $36.16/hr Remote
Teacher | $36.16/hr Remote

Crossing Hurdles • Canada

On-site
CAD 60,000 - 80,000
Writer | $36.16/hr Remote
Writer | $36.16/hr Remote

Crossing Hurdles • Canada

On-site
CAD 65,000 - 90,000
Researcher - LLMs
Researcher - LLMs

Huawei Technologies Canada Co., Ltd. • Montreal

On-site
CAD 90,000 - 130,000
AI Legal Research Evaluator (Part-Time)
AI Legal Research Evaluator (Part-Time)

Mercor • Montreal

Remote
CAD 152,000 - 190,000
English Language Specialist - Fully Remote | Upto $50/hr
English Language Specialist - Fully Remote | Upto $50/hr

Mercor • Toronto

Remote
CAD 81,000 - 115,000
Linguistic AI Auditor - French From Canada
Linguistic AI Auditor - French From Canada

Softechub • Montreal

On-site
CAD 55,000 - 75,000
AI Content Quality Evaluator
AI Content Quality Evaluator

Crossing Hurdles • Canada

On-site
CAD 60,000 - 80,000
Staff Engineer, Safety for AI Agents
Staff Engineer, Safety for AI Agents

Cohere • Toronto

Hybrid
CAD 100,000 - 150,000
Open and inclusive culture
Weekly lunch stipend
Full health and dental benefits
+4
AI Developer: Generative AI & LLMs Specialist
AI Developer: Generative AI & LLMs Specialist

LuxeTech Inc. • Canada

On-site
CAD 80,000 - 100,000