Generalist (Portuguese) | $15/hr Remote

Crossing Hurdles; Portugal; Teletrabalho; EUR 12 977 - 17 696; Tempo parcial

Resumo da oferta

A tech company is seeking a part-time LLM – AI Quality Analyst (Personalization) to evaluate personalization features for AI models. This role requires fluency in Portuguese and experience in data annotation or AI quality evaluation. The candidate will work remotely, analyzing responses, designing conversational prompts, and providing structured feedback. The position is a short-term contract for 2 months with a commitment of 20-40 hours per week, offering a competitive hourly rate.

Qualificações

• Experience in data annotation, AI quality evaluation, content moderation, or related roles.
• Fluency in Portuguese (reading and writing).
• Willingness to use a personal Google account for assessment.
• Strong analytical thinking and attention to detail.
• Experience with creative prompt engineering and personalization concepts.
• Ability to provide structured feedback and clear written explanations.
• Ability to work independently in a remote setup.
• Desktop or laptop with a stable internet connection.

Responsabilidades

• Evaluate a personalization feature for Gemini.
• Design and execute multi-turn conversational prompts that leverage personal context.
• Assess how effectively the model uses personal context for responses.
• Evaluate responses based on intent and application of personalization.
• Analyze responses for grounding issues or flawed inferences.
• Assess integration quality of personal data in responses.
• Perform side-by-side evaluations of model outputs.
• Write clear rationales for rankings of conversation turns.
• Extract and verify debug information for accuracy.
• Maintain data hygiene by deleting evaluation conversations.

Conhecimentos

Data annotation

AI quality evaluation

Content moderation

Analytical thinking

Attention to detail

Creative prompt engineering

Providing structured feedback

Descrição da oferta de emprego

Position: LLM – AI Quality Analyst (Personalization) – Portuguese

Type: Short-Term Contract (2 months)

Compensation: $11-$15 per hour

Location: Remote

Commitment: Part-time (20–40 hrs/week)

Role Responsibilities

• Evaluate a personalization feature for Gemini
• Design and execute multi-turn conversational prompts that require the AI to leverage personal context
• Assess how effectively the model uses personal context from past conversations and activity to generate relevant responses
• Evaluate responses based on intent and appropriate application of personalization
• Analyze responses for grounding issues, flawed inferences, or hallucinations
• Assess integration quality to ensure personal data is incorporated naturally into responses
• Perform side‑by‑side evaluations and stack‑rank model outputs based on usefulness, clarity, and overall experience
• Write clear rationales for rankings referencing specific conversation turns
• Extract and verify debug information to confirm correct use of summaries and data sources
• Maintain data hygiene by deleting evaluation conversations after completion

Requirements

• Experience in data annotation, AI quality evaluation, content moderation, or related roles
• Fluency in Portuguese (reading and writing)
• Willingness to use a primary personal Google account and enable personal data sources for assessment
• Strong analytical thinking and attention to detail
• Experience with creative prompt engineering and personalization concepts
• Ability to provide structured feedback and clear written explanations
• Ability to work independently in a remote setup
• Desktop or laptop with a stable internet connection