Advanced AI Evaluation & Annotation Reviewer (Portuguese)

Dorado; United States; Remote; USD 11,020 - 15,153; Full time

Job summary

Dorado is seeking language professionals for a long-term, six-month minimum engagement focused on AI evaluation and annotation. You will evaluate AI-generated content, annotate language data, and provide feedback to improve AI responses.

This role suits linguistics, translation, localization, or QA professionals interested in hands-on AI projects. The position requires Portuguese proficiency, a relevant degree or equivalent experience, and the ability to follow detailed guidelines.

Qualifications

• Fluent in Portuguese with strong written and verbal skills.
• Bachelor’s degree in Linguistics, Languages, CS or related field, or equivalent experience.
• Degree or certification in Portuguese where required.
• Strong analytical skills and high attention to detail.
• Ability to identify patterns, errors, inconsistencies, and language issues.
• Experience in annotation, evaluation, localization, or QA is helpful but not required.
• Interest in AI, ML, language tech, or data annotation.
• Ability to learn new tools and follow guidelines.

Responsibilities

• Review AI-generated responses for clarity, accuracy, and quality.
• Annotate and label language content per project guidelines.
• Generate or evaluate prompts based on assignment requirements.
• Identify linguistic errors and data concerns.
• Provide clear, structured feedback to improve AI performance.
• Communicate language requirements to linguistic and non-linguistic stakeholders.
• Collaborate with QA Leads and clients to apply feedback and maintain quality.
• Attend required client meetings with camera on.
• Submit daily work reports and meet productivity and quality expectations.

Skills

Portuguese fluency

Attention to detail

Linguistics background

Following guidelines

Independent work

Education

Bachelors in Linguistics/Languages/CS or related field

Degree/certification in Portuguese

Job description

Dorado is seeking language professionals for a long-term, six-month minimum engagement focused on AI evaluation and annotation. You will evaluate AI-generated content, annotate language data, and provide feedback to improve AI responses.

This role suits linguistics, translation, localization, or QA professionals interested in hands-on AI projects. The position requires Portuguese proficiency, a relevant degree or equivalent experience, and the ability to follow detailed guidelines.