Content Evaluator – Bilingual, French and English

Jobtailor; Deutschland; Hybrid; EUR 42.000 - 65.000; Vollzeit

Zusammenfassung

Jobtailor in Germany seeks a detail-oriented evaluator to assess AI-driven customer support interactions. You will review conversations across Instagram, WhatsApp, and Messenger, applying complex rubrics to measure quality and compliance.

This role emphasizes precision, brand voice, and multi-language proficiency in English and French. You will work with knowledge bases, product catalogs, and SOPs, performing dual reviews and calibration audits to ensure consistent scoring and actionable

Qualifikationen

• Prior experience in customer service, call centers, retail, or handling customer communications via email, chat, or phone.
• Excellent written English with strong command of tone, brand voice, grammar, and nuance.
• Excellent written French with strong command of tone, brand voice, grammar, and nuance.
• Ability to strictly follow multi-tier evaluation guidelines, complex logic trees, and technical rubrics without deviation.
• Comfort using dedicated web-based tools and labeling interfaces.

Aufgaben

• Conduct human quality evaluations for an enterprise AI customer support product across social channels (Instagram, WhatsApp, Messenger).
• Evaluate and benchmark AI model responses against complex evaluation rubrics using provided business knowledge bases.
• Review and score AI-generated customer interactions across Foundational, Experiential, and Operational dimensions, including Action Fidelity, Faithfulness, Hallucination, Compliance, Tone, and Handoff.
• Benchmark informational (R1) and transactional (R2) customer queries against authoritative sources such as FAQs, product catalogs, and SOPs within the task UI.
• Participate in dual-review processes and daily calibration audits to ensure inter-rater agreement and establish ground-truth performance targets.
• Deliver precise evaluations against performance targets.

Kenntnisse

Customer Service Experience

Written English Proficiency

Written French Proficiency

Evaluation Guidelines Adherence

Web-Based Tools Proficiency

Tools

Web-Based Tools

Labeling Interfaces

Jobbeschreibung

• Conduct human quality evaluations for an enterprise AI customer support product on Instagram, WhatsApp, and Messenger
• Evaluate and benchmark AI model responses against complex evaluation rubrics using provided business knowledge bases
• Review and score AI-generated customer interactions across Foundational, Experiential, and Operational dimensions, including Action Fidelity, Faithfulness, Hallucination, Compliance, Tone, and Handoff
• Benchmark informational (R1) and transactional (R2) customer queries against authoritative business sources such as FAQs, product catalogs, and SOPs within the task UI
• Participate in dual-review processes and daily calibration audits to ensure inter-rater agreement and establish ground-truth performance targets
• Deliver precise evaluations against performance targets

Requirements

• Prior experience in customer service, call centers, retail, or handling customer communications via email, chat, or phone (highly prioritized)
• Exceptional written English skills with a strong command of tone, brand voice, grammar, and nuance
• Exceptional written French skills with a strong command of tone, brand voice, grammar, and nuance
• Ability to strictly follow multi-tier evaluation guidelines, complex logic trees, and technical rubrics without deviation
• Comfort using dedicated web-based tools and labeling interfaces

Core Competencies

Demonstrates expertise in evaluating AI-generated customer interactions, ensuring compliance with complex evaluation rubrics and performance targets. Proficient in both English and French, with strong written communication skills tailored to brand voice and customer engagement.

Highest-signal resume keywords

• Customer Service Experience
• Written English Proficiency
• Written French Proficiency
• Evaluation Guidelines Adherence
• Web-Based Tools Proficiency

Hard Skills

• AI Model Evaluation
• Performance Benchmarking
• Evaluation Rubrics
• Complex Logic Trees
• Technical Rubrics

Soft Skills

• Attention to Detail
• Inter-Rater Agreement
• Communication Skills

Industry Keywords

• Customer Communications
• AI Customer Support
• Dual-Review Processes
• Calibration Audits
• Business Knowledge Bases

Tools & Technologies

• Web-Based Tools
• Labeling Interfaces