Portuguese Business Analyst - AI Evaluation

Vraify; Deutschland; Remote; EUR 14,000 - 20,000; Full time

Job summary

Vraify is seeking a remote contractor to evaluate AI-generated responses within a business Gmail setup. The role runs 12–16 weeks and pays up to $14/hour, with work from Germany and overlap with Pacific Time.

You will assess relevance, accuracy, and personalization, delivering structured feedback to help improve models. Applicants should have native Portuguese proficiency, strong professional English, a relevant degree, and access to a primary Gmail/Google Workspace account.

Qualifications

• Native-level Portuguese and professional English proficiency.
• Bachelor's degree or equivalent practical experience.
• Active primary Google Workspace or corporate Gmail account.
• Reside outside the United States and complete the consent process.
• Available at least 4 hours per day, up to 40 hours per week, with 4 hours overlap with Pacific Time.
• Reliable computer and internet access with strong analytical judgment and attention to detail.

Responsibilities

• Evaluate the quality and personalization of AI-generated responses for a business Gmail.
• Compare AI responses, identify unsupported assumptions or personalization issues, and select the strongest UX.
• Provide clear, structured, and well-reasoned feedback to support model improvements.
• Follow evaluation, privacy, consent, confidentiality, and quality guidelines consistently.

Skills

Portuguese proficiency

English proficiency

Analytical judgment

Attention to detail

Independent work

Education

Bachelor's degree or equivalent practical experience

Tools

Gmail

Google Workspace

Job description

Evaluate the quality and personalization of AI-generated responses using an established business Gmail. This remote contractor assignment starts immediately, runs for 12-16 weeks, and pays up to $14/hour.

What you'll do:

• Evaluate whether AI-generated responses are relevant, accurate, helpful, and appropriately personalized.
• Compare AI responses, identify unsupported assumptions or incorrect personalization, and select the stronger user experience.
• Provide clear, structured, and well-reasoned feedback that supports model improvements.
• Follow evaluation, privacy, consent, confidentiality, and quality guidelines consistently.

What we look for:

• Native-level Portuguese proficiency and strong professional English.
• At least 2 years of relevant professional experience and a bachelor's degree or equivalent practical experience.
• An active primary Google Workspace or corporate Gmail account. A professional inbox predominantly in Portuguese with approximately 1,000+ emails and regular activity.
• Must currently reside outside the United States and be willing to use the qualifying primary account and complete the required consent process.
• Available at least 4 hours per day, up to 40 hours per week, including 4 hours of overlap with Pacific Time.
• Reliable computer and internet access, strong analytical judgment, attention to detail, and the ability to work independently.