AI Content Evaluator – Quality Benchmarking (EN/VN)

Innodata Inc.; United States; Hybrid; USD 17,000 - 28,000; Full time

Job summary

Innodata Inc. is seeking detail-oriented evaluators to conduct human quality evaluations for an enterprise AI customer support product on Instagram, WhatsApp, and Messenger.

You will evaluate and benchmark AI model responses against complex evaluation rubrics using provided business knowledge bases. Ideal candidates have a background in customer service and exceptional written English, with strong Vietnamese skills and analytical precision.

Qualifications

• Customer service background is highly prioritized and beneficial.
• Excellent written English with strong tone, brand voice, grammar, and nuance.
• Vietnamese proficiency with strong tonal and contextual understanding.
• Ability to strictly follow multi-tier evaluation guidelines and complex rubrics.
• Comfort using dedicated web-based tools and labeling interfaces.

Responsibilities

• Review and score AI-generated customer interactions across dimensions (e.g., Action Fidelity, Faithfulness, Hallucination, Compliance, Tone, Handoff).
• Benchmark informational and transactional queries against official sources within the task UI.
• Participate in dual-review processes and calibration audits to ensure inter-rater agreement.
• Deliver precise evaluation targets and maintain quality standards.

Skills

Customer service

English proficiency

Vietnamese proficiency

Analytical precision

Tech adaptability

Job description

Innodata Inc. is seeking detail-oriented evaluators to conduct human quality evaluations for an enterprise AI customer support product on Instagram, WhatsApp, and Messenger.

You will evaluate and benchmark AI model responses against complex evaluation rubrics using provided business knowledge bases. Ideal candidates have a background in customer service and exceptional written English, with strong Vietnamese skills and analytical precision.