Remote Portuguese Audio Evaluation Specialist

AI Trainer Jobs; United States; Remote; USD 69,000 - 83,000; Full time

Benefits offered by this job

Hourly pay $50

Job summary

AI Trainer Jobs is seeking a Portuguese Audio Recording Expert (Portugal) for a remote evaluation track. You will review prompts and responses, compare outputs, and provide structured feedback to retrain models.

As an independent contractor, you will label edge cases, capture ambiguous prompts, and help ensure high-quality Portuguese language assessments. The role offers an hourly rate and US-eligible remote work. Strong written reasoning is valued and you will work asynchronously across batches.

Qualifications

• Prior evaluation, annotation, or human-rater experience on Portuguese content.
• Strong written reasoning and ability to name issues with rubric clauses.
• Comfort applying multi-page rubrics across long batches.

Responsibilities

• Evaluate Portuguese outputs against a rubric and assign severity tags.
• Compare paired responses and select the stronger answer with rationale.
• Label hallucinations, instruction-following failures, and unsafe content.
• Capture ambiguous prompts and route to the program team for rubric updates.

Skills

Evaluation experience

Portuguese language

Attention to detail

Async work

Inter-rater calibration

Tools

Annotation tools

Job description

AI Trainer Jobs is seeking a Portuguese Audio Recording Expert (Portugal) for a remote evaluation track. You will review prompts and responses, compare outputs, and provide structured feedback to retrain models.

As an independent contractor, you will label edge cases, capture ambiguous prompts, and help ensure high-quality Portuguese language assessments. The role offers an hourly rate and US-eligible remote work. Strong written reasoning is valued and you will work asynchronously across batches.