AI Content Evaluator – Bilingual EN/VI (Quality QA)

Innodata; United States; Hybrid; USD 23.000 - 32.000; Vollzeit

Zusammenfassung

Innodata seeks detail-oriented evaluators to conduct human quality evaluations for an enterprise AI customer support product on Instagram, WhatsApp, and Messenger. You will evaluate and benchmark AI model responses against complex evaluation rubrics using provided business knowledge bases.

You’ll thrive if you have strong English and Vietnamese writing skills, a customer service background, and a disciplined approach to following multi-tier guidelines.

Qualifikationen

• Customer service experience in call centers, retail, or handling inquiries via email, chat, or phone.
• Excellent written English with strong tone, brand voice, grammar, and nuance.
• Excellent written Vietnamese with strong tone, brand voice, grammar, and nuance.
• Ability to strictly follow multi-tier evaluation guidelines and complex rubrics.

Aufgaben

• Review and score AI-generated customer interactions across dimensions like Action Fidelity, Faithfulness, Hallucination, Compliance, Tone, and Handoff.
• Benchmark informational (R1) and transactional (R2) queries against authoritative sources within the task UI.
• Participate in dual-review processes and calibration audits to ensure inter-rater agreement and ground-truth targets.
• Deliver precise evaluation within established performance targets.

Jobbeschreibung

Innodata seeks detail-oriented evaluators to conduct human quality evaluations for an enterprise AI customer support product on Instagram, WhatsApp, and Messenger. You will evaluate and benchmark AI model responses against complex evaluation rubrics using provided business knowledge bases.

You’ll thrive if you have strong English and Vietnamese writing skills, a customer service background, and a disciplined approach to following multi-tier guidelines.