Portuguese Audio Evaluations Specialist - Freelance AI Trainer Project

Jobgether SRL; Canada; Remote; CAD 12,000 - 128,000; Full time

Benefits offered by this job

Fully remote work

Contractor engagement

Job summary

Jobgether SRL, on behalf of a partner company, seeks a Portuguese Audio Evaluations Specialist for a remote freelance AI trainer project based in Canada. You will design and run simulated customer support interactions to help evaluate how well AI systems understand spoken requests and complete tasks across travel, financial services, and technical support.

You will generate structured evaluation data, assess audio comprehension and naturalness, and review basic programming literacy in AI

Qualifications

• Native or bilingual Portuguese with strong reading, listening, writing, and speaking skills.
• Professional experience in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Ability to evaluate complex conversations systematically and autonomously.
• Familiarity with JSON structures and basic programming concepts.
• Excellent attention to detail when working with structured prompts, evaluation frameworks, and technical requirements.

Responsibilities

• Create evaluation scenarios and assess conversational AI performance.
• Design and conduct realistic role-play simulations across travel, finance, and technical support.
• Evaluate AI-generated conversations against qualitative and quantitative criteria.
• Assess task completion accuracy and naturalness of responses.
• Produce structured evaluation outputs to support model improvements.

Skills

Portuguese proficiency

Customer support experience

Analytical thinking

Attention to detail

Basic programming literacy

JSON familiarity

Tools

JSON basics

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Portuguese Audio Evaluations Specialist – Freelance AI Trainer Project based in Canada.

Contribute to the development of advanced conversational AI by evaluating audio-based models in realistic customer support scenarios. In this remote freelance project, you will design and execute simulated interactions across travel, financial services, and technical support. Your evaluations will help measure how accurately AI systems understand spoken requests, complete tasks, and communicate naturally. You will also assess basic programming-related reasoning and contribute to high-quality datasets that improve model performance. This opportunity is suited to language experts and customer support professionals who combine strong Portuguese proficiency with analytical thinking, technical curiosity, and meticulous attention to detail.

Accountabilities

You will independently create evaluation scenarios, assess conversational AI performance, and produce structured data that helps improve the reliability and quality of advanced audio models.

• Design and conduct realistic role-play scenarios that simulate complex customer support interactions in travel, finance, and technical support.
• Evaluate AI-generated audio conversations against standardized qualitative and quantitative criteria.
• Assess task completion accuracy, conversational naturalness, audio comprehension, and the relevance of responses.
• Review the model's basic programming literacy, including its understanding of JSON structures, functions, methods, and simple logic in customer support contexts.
• Generate diverse, high-quality audio evaluation datasets that reflect real-world expectations for clarity, efficiency, and natural conversation.
• Follow detailed prompts, evaluation rubrics, and technical guidelines to ensure consistent and reliable results.
• Identify weaknesses in model performance and provide structured evaluation outputs to support improvements in conversational AI.

Requirements

The ideal candidate has strong Portuguese language skills, professional experience in customer-facing or technical support environments, and the ability to evaluate complex conversations systematically. You should be comfortable working independently and following precise technical instructions.

• Native or bilingual proficiency in Portuguese, with strong reading, listening, writing, and speaking skills.
• Professional experience in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Strong analytical abilities and verbal communication skills, including the ability to perform realistic customer support role-plays.
• Basic programming literacy, including familiarity with JSON structures, functions, methods, and simple logic.
• Excellent attention to detail when working with structured prompts, evaluation frameworks, and technical requirements.
• Access to a high-quality microphone to ensure clear and reliable audio input during evaluations.
• A secure computer and high-speed internet connection suitable for remote work.
• Ability to work autonomously as a freelance or independent contractor.

Benefits

• Compensation ranging from USD 6 to USD 65 per hour, depending on experience, expertise, and geographic location. The final rate may vary from the advertised range.
• Fully remote work arrangement.
• Freelance/independent contractor engagement.
• Opportunity to contribute to the evaluation and improvement of advanced conversational AI models.
• Flexible project-based work environment, subject to project requirements.
• Contractors must provide their own computer and high-speed internet.
• Health insurance and paid time off are not included in this independent contractor engagement.

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.