Remote AI Quality Analyst: Personalization (Portuguese)

Crossing Hurdles; Portugal; Remote; EUR 12.977 - 17.696; Teilzeit

Zusammenfassung

A tech company is seeking a part-time LLM – AI Quality Analyst (Personalization) to evaluate personalization features for AI models. This role requires fluency in Portuguese and experience in data annotation or AI quality evaluation. The candidate will work remotely, analyzing responses, designing conversational prompts, and providing structured feedback. The position is a short-term contract for 2 months with a commitment of 20-40 hours per week, offering a competitive hourly rate.

Qualifikationen

• Experience in data annotation, AI quality evaluation, content moderation, or related roles.
• Fluency in Portuguese (reading and writing).
• Willingness to use a personal Google account for assessment.
• Strong analytical thinking and attention to detail.
• Experience with creative prompt engineering and personalization concepts.
• Ability to provide structured feedback and clear written explanations.
• Ability to work independently in a remote setup.
• Desktop or laptop with a stable internet connection.

Aufgaben

• Evaluate a personalization feature for Gemini.
• Design and execute multi-turn conversational prompts that leverage personal context.
• Assess how effectively the model uses personal context for responses.
• Evaluate responses based on intent and application of personalization.
• Analyze responses for grounding issues or flawed inferences.
• Assess integration quality of personal data in responses.
• Perform side-by-side evaluations of model outputs.
• Write clear rationales for rankings of conversation turns.
• Extract and verify debug information for accuracy.
• Maintain data hygiene by deleting evaluation conversations.

Kenntnisse

Data annotation

AI quality evaluation

Content moderation

Analytical thinking

Attention to detail

Creative prompt engineering

Providing structured feedback

Jobbeschreibung

A tech company is seeking a part-time LLM – AI Quality Analyst (Personalization) to evaluate personalization features for AI models. This role requires fluency in Portuguese and experience in data annotation or AI quality evaluation. The candidate will work remotely, analyzing responses, designing conversational prompts, and providing structured feedback. The position is a short-term contract for 2 months with a commitment of 20-40 hours per week, offering a competitive hourly rate.