Remote Multilingual Audio Evaluator for AI Conversations

Anyone AI Inc.; Paris; Remote; EUR 21,000 - 39,000; Part time

Benefits offered by this job

Remote work

Job summary

Anyone AI Inc. seeks multilingual audio evaluators to assess how conversational AI agents perform across languages. You will participate in live roleplay sessions, capture recordings and logs, and label transcripts using structured rubrics to improve AI interactions.

Ideal candidates have C1/C2 language proficiency, strong JSON skills, and attention to detail. Remote, project-based work with international scope is offered.

Qualifications

• C1/C2 spoken fluency in at least one target language.
• Strong ability to read and write in professional contexts.
• Experience with evaluating AI interactions or transcripts is a plus.

Responsibilities

• Prepare tools and access before live sessions.
• Conduct live roleplay sessions with conversational AI agents.
• Capture recordings and logs for evaluation.
• Label transcripts and score interactions using rubrics.
• Provide written explanations supporting scores and validate JSON structures.

Skills

Multilingual fluency (C1/C2)

Attention to detail

Clear written communication

Tools

JSON validation

Job description

Anyone AI Inc. seeks multilingual audio evaluators to assess how conversational AI agents perform across languages. You will participate in live roleplay sessions, capture recordings and logs, and label transcripts using structured rubrics to improve AI interactions.

Ideal candidates have C1/C2 language proficiency, strong JSON skills, and attention to detail. Remote, project-based work with international scope is offered.