Global Multilingual AI Evaluator (Remote)

Anyone AI Inc.; Lisboa; À distance; EUR 28 000 - 55 000; Temps partiel

Résumé du poste

Anyone AI Inc. is seeking multilingual audio evaluators to assess conversational AI agents across languages. This remote, project-based role runs for 2–3 months and involves live roleplay sessions, recordings, and transcript labeling.

You will apply rubrics and provide written explanations to support scores. We require C1/C2 fluency in at least one target language and strong JSON skills. Experience in AI evaluation is a plus, with attention to detail and clear written communication as essential

Qualifications

• Must have C1/C2 spoken fluency in at least one target language.
• Ability to demonstrate language proficiency through speaking and listening assessments.
• Strong JSON skills including validation and troubleshooting.
• Comfort with digital tools and capturing recordings and logs.
• Excellent attention to detail and adherence to guidelines.

Responsabilités

• Prepare required tools and access before each live session.
• Conduct live roleplay sessions with conversational AI agents.
• Capture recordings, session IDs, and logs for analysis.
• Label transcripts according to project guidelines.
• Score interactions using structured rubrics and justify scores in writing.
• Read, validate, and troubleshoot JSON for structural issues.

Connaissances

Fluency in target language (C1/C2)

Strong JSON skills

Attention to detail

Clear written communication

Ability to follow evaluation rubrics

Outils

JSON validation tools

Description du poste

Anyone AI Inc. is seeking multilingual audio evaluators to assess conversational AI agents across languages. This remote, project-based role runs for 2–3 months and involves live roleplay sessions, recordings, and transcript labeling.

You will apply rubrics and provide written explanations to support scores. We require C1/C2 fluency in at least one target language and strong JSON skills. Experience in AI evaluation is a plus, with attention to detail and clear written communication as essential