French, German or Korean Business Analyst - AI Evaluation

Vraify; Deutschland; Remote; EUR 14,000 - 20,000; Full time

Job summary

Vraify is seeking a remote contractor to evaluate AI-generated responses for quality and personalization. The role runs 12-16 weeks and pays up to $14 per hour.

You’ll assess relevance, accuracy, and helpfulness, then document structured feedback to help improve models and user experience. Applicants should have native-level proficiency in French, German, or Korean and strong professional English, plus 2+ years of relevant experience and a bachelor's degree or equivalent.

Qualifications

• Bachelor's degree or equivalent practical experience.
• Native-level proficiency in French, German or Korean and strong professional English.
• Active Google Workspace or corporate Gmail account with the target language as the majority.
• Willingness to reside outside the United States and complete the consent process.
• Availability for 4 hours/day, up to 40 hours/week, with 4 hours overlap with Pacific Time.
• Reliable computer and internet access; strong analytical judgment; attention to detail; ability to work independently.

Responsibilities

• Evaluate whether AI-generated responses are relevant, accurate, helpful, and appropriately personalized.
• Compare AI responses, identify unsupported assumptions or incorrect personalization, and select the stronger user experience.
• Provide clear, structured, and well-reasoned feedback to support model improvements.
• Follow evaluation, privacy, consent, confidentiality, and quality guidelines consistently.

Skills

Analytical thinking

Attention to detail

Independent work

Strong English proficiency

Education

Bachelor's degree or equivalent practical experience

Tools

Google Workspace

Gmail

Job description

Evaluate the quality and personalization of AI-generated responses using an established business Gmail. This remote contractor assignment starts immediately, runs for 12-16 weeks, and pays up to $14/hour.

What you’ll do:

• Evaluate whether AI-generated responses are relevant, accurate, helpful, and appropriately personalized.
• Compare AI responses, identify unsupported assumptions or incorrect personalization, and select the stronger user experience.
• Provide clear, structured, and well-reasoned feedback that supports model improvements.
• Follow evaluation, privacy, consent, confidentiality, and quality guidelines consistently.

What we look for:

• Native-level French, German or Korean proficiency and strong professional English.
• At least 2 years of relevant professional experience and a bachelor's degree or equivalent practical experience.
• An active primary Google Workspace or corporate Gmail account. A professional inbox with the target language as the majority language, meaningful English content, and approximately 1,000+ emails.
• Must currently reside outside the United States and be willing to use the qualifying primary account and complete the required consent process.
• Available at least 4 hours per day, up to 40 hours per week, including 4 hours of overlap with Pacific Time.
• Reliable computer and internet access, strong analytical judgment, attention to detail, and the ability to work independently.