Remote Portuguese Audio Evaluation Specialist

Invisible Technologies Inc.; United States; Remote; USD 8,300 - 90,000; Full time

Job summary

Invisible Technologies is seeking independent Audio Evaluation Specialists for an AI benchmark project evaluating agentic audio models in real-world customer support scenarios across travel, financial services, and telecommunications. You will design role-play scenarios, audit model outputs, and help create high-quality audio datasets to improve model performance.

Applicants should have professional experience in complex customer support or conversational AI evaluation, be bilingual, and possess

Qualifications

• Professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Native or bilingual proficiency in the target language with strong reading, listening, writing, and speaking skills.
• Basic understanding of JSON structures, functions, and logic.
• Meticulous approach to structured prompts, evaluation rubrics, and technical guidelines.

Responsibilities

• Design and execute complex role-play evaluation scenarios across travel, finance, and technical support domains.
• Audit AI model performance using qualitative and quantitative metrics focusing on task completion and natural conversation.
• Evaluate model understanding of JSON data structures and reasoning within a support context.
• Contribute to creating diverse, high-quality audio datasets reflecting real customer interactions.

Skills

Customer support expertise

Bilingual proficiency

JSON literacy

Analytical communication

Attention to detail

Tools

JSON basics

Job description

Invisible Technologies is seeking independent Audio Evaluation Specialists for an AI benchmark project evaluating agentic audio models in real-world customer support scenarios across travel, financial services, and telecommunications. You will design role-play scenarios, audit model outputs, and help create high-quality audio datasets to improve model performance.

Applicants should have professional experience in complex customer support or conversational AI evaluation, be bilingual, and possess