Remote Freelance Audio Evaluation Specialist

remote work; United States; Remote; USD 15,000 - 42,000; Full time

Job summary

Meridial is seeking a freelance evaluator to design and run role-play scenarios that test conversational audio agents across sectors like travel and finance. You will help build datasets and use qualitative and quantitative metrics to gauge model performance, focusing on naturalness, comprehension, and response quality.

The role emphasizes strong English communication, comfort with prompts and JSON guidelines, and the ability to provide clear, actionable feedback on complex audio interactions.

Qualifications

• Strong verbal communication in simulated customer support contexts.
• English proficiency across reading, listening, writing and speaking.
• Ability to work with prompts, rubrics and technical guidelines.
• Familiarity with JSON structures and simple programming concepts.
• Comfort evaluating complex audio interactions and providing clear feedback.

Responsibilities

• Create and execute role play evaluation scenarios across travel, financial services, telecommunications and technical support.
• Contribute to diverse datasets used to assess conversational audio agents.
• Evaluate model performance using qualitative and quantitative metrics.
• Assess task completion, naturalness, audio comprehension and response quality.
• Interpret structured data and simple logic within evaluation tasks.

Skills

Strong verbal communication

English proficiency

Prompts & rubrics familiarity

JSON structures familiarity

Job description

Meridial is seeking a freelance evaluator to design and run role-play scenarios that test conversational audio agents across sectors like travel and finance. You will help build datasets and use qualitative and quantitative metrics to gauge model performance, focusing on naturalness, comprehension, and response quality.

The role emphasizes strong English communication, comfort with prompts and JSON guidelines, and the ability to provide clear, actionable feedback on complex audio interactions.