Bilingual AI Content Evaluator — Quality & Compliance

Dorado; United States; Hybrid; USD 40,000 - 60,000; Full time

Job summary

Innodata seeks detail-oriented evaluators to conduct human quality evaluations for an enterprise AI customer support product on Instagram, WhatsApp, and Messenger. You will review AI interactions and score them against complex rubrics using business knowledge bases.

Ideal candidates have customer service experience, exceptional written English and French, and a disciplined approach to following evaluation guidelines.

Qualifications

• Prior experience in customer service, call centers, retail, or handling customer communications via email, chat, or phone.
• Exceptional written English with a strong command of tone, brand voice, grammar, and nuance.
• Exceptional written French with a strong command of tone, brand voice, grammar, and nuance.
• Ability to strictly follow multi-tier evaluation guidelines, complex logic trees, and technical rubrics without deviation.
• Comfort using dedicated web-based tools and labeling interfaces.

Responsibilities

• Model Evaluation: Review and score AI-generated customer interactions across Foundational, Experiential, and Operational dimensions (e.g., Action Fidelity, Faithfulness, Hallucination, Compliance, Tone, and Handoff).
• Intent & Fact Verification: Benchmark both informational (R1) and transactional (R2) customer queries against authoritative business sources (FAQs, product catalogs, SOPs) within the task UI.
• Quality Assurance: Participate in dual-review processes and daily calibration audits to ensure inter-rater agreement and establish ground-truth performance targets.
• Performance Targets: Deliver precise evaluation

Skills

Customer service background

English proficiency

French proficiency

Analytical precision

Tech adaptability

Job description

Innodata seeks detail-oriented evaluators to conduct human quality evaluations for an enterprise AI customer support product on Instagram, WhatsApp, and Messenger. You will review AI interactions and score them against complex rubrics using business knowledge bases.

Ideal candidates have customer service experience, exceptional written English and French, and a disciplined approach to following evaluation guidelines.